Commit 878ff03
committed
[Kernel][Perf] Tune H20 block-FP8 MoE for low-batch decode
Retune the E=256, N=256 H20-3e block-FP8 configuration used by GLM-5.3 TP8 and DeepSeek models. Narrower N tiles improve SM utilization for M=1 through M=8 while leaving larger batches unchanged.
AI assistance was used for analysis, benchmarking, and edits.
Co-authored-by: Codex <noreply@openai.com>
Signed-off-by: liuyao0322 <yaoliu548926@gmail.com>1 parent 22df3a3 commit 878ff03
1 file changed
Lines changed: 6 additions & 6 deletions
File tree
- vllm/model_executor/layers/fused_moe/configs
Lines changed: 6 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
8 | | - | |
| 8 | + | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
| 12 | + | |
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
28 | | - | |
| 28 | + | |
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
| 32 | + | |
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
| |||
0 commit comments