feat(rollout): add continuous batching generation prototype #4158
Triggered via pull request
September 2, 2026 11:52
nathon-lee
nathon-lee
review_requested
#8368
Status
Cancelled
Total duration
2s
Artifacts
–
modal-torch-latest.yml
on: pull_request_target
modal-torch-latest / collect tests
modal-torch-latest / DeepSpeedAI CI
Annotations
1 error
|
modal-torch-latest
Canceling since a higher priority waiting request for modal-torch-latest-8368 exists
|