Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(BA-442): Distribute model service replica containers whenever possible #3693

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

jopemachine
Copy link
Member

@jopemachine jopemachine commented Feb 13, 2025

Resolves #3349 (BA-442). (WIP)

Checklist: (if applicable)

  • Milestone metadata specifying the target backport version
  • Mention to the original issue

@github-actions github-actions bot added comp:manager Related to Manager component size:M 30~100 LoC labels Feb 13, 2025
@jopemachine jopemachine changed the title feat: Distribute model service replica containers whenever possible feat(BA-442): Distribute model service replica containers whenever possible Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:manager Related to Manager component size:M 30~100 LoC
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Develop logic to distribute model service replica containers across different GPU servers whenever possible
1 participant