feat(attn): add paged-decode tuple 16,128,64,false,true,false - #526
Merged
Conversation
Muse-Glimmer-30B uses local attention with qgroup=16, head=128, page=64. The causal=false/local=false/sink=false sibling is already compiled for GLM/Seed. Without the local=true specialization the first paged-decode warmup raises: RuntimeError: Paged decode kernel tuple not compiled for this configuration. 16,128,64,false,true,false Format: qgroup,headsize,pagesize,causal,local,sink. Signed-off-by: SergiioB <sergiobarrientose@outlook.com>
Contributor
There was a problem hiding this comment.
Pull request overview
Adds a missing paged-decode kernel tuple to the default Xe2 paged-decode configuration so models requiring qgroup=16, head_size=128, page_size=64, causal=false, local=true, sink=false (e.g., Muse-Glimmer-30B) don’t fail warmup with a “tuple not compiled” runtime error.
Changes:
- Add the
16,128,64,false,true,falsetuple topaged_decode_default.conf. - Document the tuple addition inline with a short model note.
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
baodii
approved these changes
Aug 14, 2026
jikunshang
enabled auto-merge (squash)
August 14, 2026 02:53
zufangzhu
approved these changes
Aug 14, 2026
cursor Bot
pushed a commit
to krisclarkdev/vllm-xpu-kernels
that referenced
this pull request
Aug 17, 2026
Resolve paged_decode_default.conf conflict by keeping both the pagesize=128 GLM/Seed entry from this PR and the Muse-Glimmer local-attn tuple from vllm-project#526. Signed-off-by: Kristopher Clark <krisclarkdev@krisbox.org> Co-authored-by: Cursor <cursoragent@cursor.com> Signed-off-by: Kristopher Clark <krisclarkdev@krisbox.org>
jikunshang
added a commit
that referenced
this pull request
Sep 2, 2026
Muse-Glimmer-30B uses local attention with qgroup=16, head=128, page=64. The causal=false/local=false/sink=false sibling is already compiled for GLM/Seed. Without the local=true specialization the first paged-decode warmup raises: RuntimeError: Paged decode kernel tuple not compiled for this configuration. 16,128,64,false,true,false Format: qgroup,headsize,pagesize,causal,local,sink. Signed-off-by: SergiioB <sergiobarrientose@outlook.com> Co-authored-by: SergiioB <sergiobarrientose@outlook.com> Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Cherry-pick from #524
Muse-Glimmer-30B uses local attention with qgroup=16, head=128, page=64. The causal=false/local=false/sink=false sibling is already compiled for GLM/Seed. Without the local=true specialization the first paged-decode warmup raises:
RuntimeError: Paged decode kernel tuple not compiled for this
configuration. 16,128,64,false,true,false
Format: qgroup,headsize,pagesize,causal,local,sink.
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS ABOVE HAVE BEEN CONSIDERED.
Purpose
Test Plan
Test Result
(Optional) Documentation Update
BEFORE SUBMITTING, PLEASE READ https://docs.vllm.ai/en/latest/contributing (anything written below this line will be removed by GitHub Actions)