Skip to content

Switch to Kueue service backend #723

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 231 commits into from
Mar 27, 2025
Merged

Switch to Kueue service backend #723

merged 231 commits into from
Mar 27, 2025

Conversation

cortadocodes
Copy link
Member

@cortadocodes cortadocodes commented Feb 17, 2025

Summary

This release switches to running Twined services on Kubernetes + Kueue. This brings the following features:

  • Queue questions so they're not just dropped if the service backend is overwhelmed
  • Run questions that take any amount of time (specifically opening us up to runs > 1 hour)
  • Request arbitrary compute resources per question (CPU, memory, storage etc.)
  • Stop extraneous question reruns by allowing us to control when we acknowledge question events
  • Monitor running questions individually
  • Make it easier to run questions on providers other than Google in the future (i.e. on any Kubernetes cluster)

Contents (#723)

IMPORTANT: There are breaking changes.

New features

Enhancements

  • Add allow_not_found option to ServiceConfiguration.from_file
  • Add default event store ID to get_events
  • Increase default maximum heartbeat interval to 360s

Refactoring

Dependencies

  • Remove gunicorn and Flask dependencies

Operations

  • Replace Terraform configuration with new terraform-octue-twined-core module

Testing

  • Move deployment test to octue/example-service-kueue repository

@cortadocodes cortadocodes changed the title Switch to Kubernetes + Kueue service backend Switch to Kueue service backend Mar 25, 2025
@cortadocodes cortadocodes merged commit 0e40550 into main Mar 27, 2025
5 checks passed
@cortadocodes cortadocodes deleted the rc-kueue branch March 27, 2025 12:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create Kueue service backend
3 participants