Skip to content

attn: enable Split-K for mix-batch decode rows - #485

Open
krisclarkdev wants to merge 7 commits into
vllm-project:mainfrom
krisclarkdev:perf/mixbatch-decode-splitk
Open

attn: enable Split-K for mix-batch decode rows#485
krisclarkdev wants to merge 7 commits into
vllm-project:mainfrom
krisclarkdev:perf/mixbatch-decode-splitk

Merge branch 'main' into perf/mixbatch-decode-splitk

885332b
Select commit
Loading
Failed to load commit list.