Skip to content

feat(rollout): add continuous batching generation prototype - #8368

Merged
delock merged 17 commits into
deepspeedai:masterfrom
nathon-lee:perf/opsd-continuous-batching-prototype
Sep 11, 2026
Merged

feat(rollout): add continuous batching generation prototype#8368
delock merged 17 commits into
deepspeedai:masterfrom
nathon-lee:perf/opsd-continuous-batching-prototype

Merge branch 'master' into perf/opsd-continuous-batching-prototype

5730ddb
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 11, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO