Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
121 commits
Select commit Hold shift + click to select a range
4d6b653
fix(rocm): fold LLMM1 partials 16..31 on wave32
FaisalBiyari Oct 11, 2026
a635342
fix(rocm): refuse wvSplitK on gfx10 instead of hitting the device assert
BlivionIaG Oct 11, 2026
bab3c17
cleanup(rocm): build only the launched W4A8 sdot4 config
BlivionIaG Oct 12, 2026
b883821
fix(rdna): follow-ups from the 2026-10-16 cleanup PRs (#101-#106)
BlivionIaG Oct 16, 2026
5b11ad0
feat(rdna2): opt-in MoE routing statistics collector and hetero-MoE p…
BlivionIaG Nov 7, 2026
122385b
feat(rdna2): hetero-MoE solver island_mode partition, spill-aware cos…
BlivionIaG Nov 7, 2026
d7ab3ef
docs(rdna2): expert-stats doc links the hetero-MoE spec commit [skip ci]
BlivionIaG Nov 7, 2026
d001aa6
feat(rdna2): VLLM_EXPERT_STATS_ALL_RANKS debug option records every T…
BlivionIaG Nov 7, 2026
165ff38
docs(rdna2): disaggregation is opt-in only, rework scheduled [skip ci]
BlivionIaG Nov 7, 2026
72e1a15
feat(rdna2): T10 driver and agentic load hook for the expert-stats co…
BlivionIaG Nov 7, 2026
5a3b221
Merge remote-tracking branch 'origin/rdna_extras' into feat/expert-stats
BlivionIaG Nov 7, 2026
7eefdc1
fix(rdna2): T10 driver arm_config status, boot only on a quiet host […
BlivionIaG Nov 7, 2026
eeec2b0
fix(rdna2): T10 driver reads the integer pci_bus_id of torch ROCm [sk…
BlivionIaG Nov 7, 2026
f784d91
feat(rdna2): T10 report tool (ITL ABBA table, counts/ordering/rank ch…
BlivionIaG Nov 7, 2026
d4bfd01
feat(pciescope): data model, Collector protocol, sysfs layer, package…
BlivionIaG Nov 7, 2026
5aa97bb
feat(pciescope): topology discovery from sysfs, passive collectors sy…
BlivionIaG Nov 7, 2026
8f27c59
feat(pciescope): session store, sampling runner with event detection,…
BlivionIaG Nov 7, 2026
6b887fd
feat(pciescope): tui dashboard (topology, live, matrix, errors, measu…
BlivionIaG Nov 7, 2026
38e7f10
fix(pciescope): tui topology colours only fabric errors, shorter expo…
BlivionIaG Nov 7, 2026
0804533
feat(pciescope): tui follows the final plx metric names (port.rx/tx_g…
BlivionIaG Nov 7, 2026
a30a47d
feat(pciescope): tui measure panel on the probe api (progress, dry-ru…
BlivionIaG Nov 7, 2026
7fe189b
test(pciescope): tui views fit 160x50 .. 40x12 terminals [skip ci]
BlivionIaG Nov 7, 2026
ea3c747
feat(pciescope): PEX88096 switch telemetry: plx collector, root BAR0 …
BlivionIaG Nov 7, 2026
43261ce
feat(pciescope): cli verbs, mcp stdio server, snapshot views; links i…
BlivionIaG Nov 7, 2026
cf60170
fix(pciescope): plx status honours --switch, clearer --exclude help […
BlivionIaG Nov 7, 2026
6e9ffe4
fix(pciescope): plx collector reads resource0 under --sysfs-root, so …
BlivionIaG Nov 7, 2026
ffb2e8f
test(pciescope): tui fixture uses plx.corr_status [skip ci]
BlivionIaG Nov 7, 2026
c0f416d
feat(pciescope): plx port map carries HIP index, smi index, lease slo…
BlivionIaG Nov 7, 2026
d431192
feat(pciescope): plx joins the default collector set (skipped when un…
BlivionIaG Nov 7, 2026
e1b34ee
docs(pciescope): switch section: current AER counters, evidence that …
BlivionIaG Nov 7, 2026
11960f9
feat(pciescope): active probe engine (plan, lease and safety guards, …
BlivionIaG Nov 7, 2026
8eb0b97
test(pciescope): track the audit log fixtures that .gitignore '*.log'…
BlivionIaG Nov 7, 2026
6be7098
feat(pciescope): never wake a sleeping device (pcie.asleep, gpu.aslee…
BlivionIaG Nov 7, 2026
3691ed6
feat(pciescope): probe times the host doorbell round trip; dry runs l…
BlivionIaG Nov 7, 2026
89109d7
feat(p2p_probe): host transfers, latency curves, batch protocol for p…
BlivionIaG Nov 7, 2026
e752b19
test(pciescope): probe plan, guard and api tests for the doorbell ste…
BlivionIaG Nov 7, 2026
8d65b01
docs(pciescope): active probe section: scenarios, suites, safety rule…
BlivionIaG Nov 7, 2026
31183af
feat(pciescope): pciescope plx passes --help through; snapshot text s…
BlivionIaG Nov 7, 2026
6011071
feat(pciescope): tui shows asleep for runtime-suspended ports, links …
BlivionIaG Nov 7, 2026
3f83a4e
fix(p2p_probe): calibrate the tick rate before printing READY; distru…
BlivionIaG Nov 7, 2026
85b27f4
fix(pciescope): tui matrix sizes per direction (host doorbell size 0)…
BlivionIaG Nov 7, 2026
084e4de
docs(pciescope): core sections (fabric, usage, data model, storage, M…
BlivionIaG Nov 7, 2026
42c899a
docs(pciescope): status line and box test count at the pushed head [s…
BlivionIaG Nov 7, 2026
b060c54
fix(pciescope): dry run reports the lease holder files it needs; doc …
BlivionIaG Nov 7, 2026
ccd9e6c
fix(pciescope): refused measure runs leave no session (LazySession); …
BlivionIaG Nov 7, 2026
f5a97fd
docs(pciescope): TUI passive wording includes the plx BAR0 reads; doc…
BlivionIaG Nov 7, 2026
834bcd3
pciescope plx: fence the counter writes for the approved switch B run
BlivionIaG Nov 7, 2026
e7fdd4c
fix(rdna2): expert-stats close() runs in inference mode (final snapsh…
BlivionIaG Nov 7, 2026
c087ddc
fix(rdna2): T10 driver drops the F arms when the GPU kernel tests fai…
BlivionIaG Nov 7, 2026
5888926
feat(rdna2): T10 real routing stats windows, H1/H2 plans solved on on…
BlivionIaG Nov 7, 2026
8b630b4
feat(pciescope): host transfer records carry the seconds the probe me…
BlivionIaG Nov 7, 2026
a08c0fa
docs(rdna2): T10 expert-stats on V620 slot B: ABBA overhead, collecto…
BlivionIaG Nov 7, 2026
999f34c
fix(pciescope): eviction guard stops flagging the probe's own first-u…
BlivionIaG Nov 7, 2026
b007218
fix(pciescope): push ceiling finding only from 1 MiB; doc: measured n…
BlivionIaG Nov 7, 2026
ed2a598
[RDNA][hetero-moe] hx broadcast exchange, decode dispatch rules, runt…
BlivionIaG Nov 7, 2026
08b4215
docs(pciescope): probe section: measured numbers marked pre-move, res…
BlivionIaG Nov 7, 2026
7fe6c9d
[RDNA][hetero-moe] spill_k records its dispatch rule and exchange; K …
BlivionIaG Nov 7, 2026
066237e
docs(rdna2): T10 T2 resume note after the box drain [skip ci]
BlivionIaG Nov 7, 2026
046a09c
feat(pciescope): report shows per-link utilisation from the switch tr…
BlivionIaG Nov 7, 2026
1d28415
docs(pciescope): practical ceiling is an upper bound (ECRC adds 4 B, …
BlivionIaG Nov 7, 2026
46868fb
[RDNA][hetero-moe] t10_run.sh: interim box layout (HIP 2-5, lease tag…
BlivionIaG Nov 10, 2026
f03093a
pciescope plx: calibrate the payload model on the live counters (post…
BlivionIaG Nov 10, 2026
fe57c33
feat(pciescope): documented layouts table (interim six V620 behind on…
BlivionIaG Nov 10, 2026
d853b47
feat(rdna2): T10 plans regenerated with the hx broadcast exchange, ru…
BlivionIaG Nov 10, 2026
bee4bfd
feat(pciescope): report ceilings per link class (x16 uplink and on-ca…
BlivionIaG Nov 10, 2026
3c6289a
docs(pciescope): interim layout (six V620 behind one switch, x8 links…
BlivionIaG Nov 10, 2026
8b8b9c7
pciescope plx: derive the interim layout (one chip, six V620, uplink …
BlivionIaG Nov 10, 2026
a651011
pciescope plx: interim capture follows the layout table (slot per lea…
BlivionIaG Nov 10, 2026
0a33892
feat(pciescope): tui measure presets follow the leaf lease slots, dro…
BlivionIaG Nov 10, 2026
4329c3e
docs(pciescope): interim box after the switch reader and probe re-der…
BlivionIaG Nov 10, 2026
1128bd1
feat(pciescope): probe lease layouts: interim box leases a2/b4 from t…
BlivionIaG Nov 10, 2026
b8ad25e
feat(pciescope): probe plans follow the leaves of the interim box (cr…
BlivionIaG Nov 10, 2026
28c47c5
feat(pciescope): probe effectiveness on the x8 interim box: audit bas…
BlivionIaG Nov 10, 2026
72b57f3
docs(pciescope): probe on the interim box: x8 effectiveness gate, rea…
BlivionIaG Nov 10, 2026
db0b727
docs(rdna2): disagg G0 rework section: H6, CPU chunk evidence, opt-in…
BlivionIaG Nov 10, 2026
3917a2d
[RDNA][hetero-moe] trace_check: row-independence test on the top-k id…
BlivionIaG Nov 10, 2026
1144932
docs(rdna2): T10 follow-up T2 on HIP 2-5: fused collector +0.5 ms, fi…
BlivionIaG Nov 10, 2026
b0a52c1
hetero-moe: correlated row model for simulate/solve (fit from the T10…
BlivionIaG Nov 10, 2026
3cb6a38
docs(rdna2): disagg G0 rework results: decoder bitwise equals the bas…
BlivionIaG Nov 10, 2026
2c22525
docs(rdna2): disagg G0 rework: contract is the baseline's resumed run…
BlivionIaG Nov 10, 2026
d36a43d
hetero-moe simulate: hub_touched_all_per_step, n_eval_layers, --rows …
BlivionIaG Nov 10, 2026
8bb3c86
pciescope(plx): counter window on the interim chip (2026-11-10) - res…
BlivionIaG Nov 10, 2026
598a37d
docs(rdna2): disagg G0 rework, second window: mono is exact vs the re…
BlivionIaG Nov 10, 2026
75f2f5e
docs(rdna2): disagg G0 rework, third window: with the consumer's unpa…
BlivionIaG Nov 11, 2026
1136bb9
Merge feat/expert-stats: opt-in MoE routing statistics and hetero pla…
BlivionIaG Nov 11, 2026
0af8414
Merge origin/rdna_extras into fix/cleanup-followups
BlivionIaG Nov 11, 2026
fbc62ee
docs(rdna2): the GDN kkt hang record predates the kkt fix; skip stays…
BlivionIaG Nov 11, 2026
1752785
Merge origin/rdna_extras into port/faisal-skinny-wave32
BlivionIaG Nov 11, 2026
e7ee449
Merge origin/rdna_extras into cursor/trim-w4a8-dead-configs-5089
BlivionIaG Nov 11, 2026
8efea0e
test(rocm): add an LLMM1 shape that fails without the wave32 reductio…
BlivionIaG Nov 11, 2026
00c19d7
docs(rdna2): GQA decode kernel passes the n_dec>=2 repro; replace the…
BlivionIaG Nov 11, 2026
69e9473
ci(docker): resolve the pinned apt packages against a dated Ubuntu sn…
BlivionIaG Nov 11, 2026
66b6b51
tools(rdna): concurrency probe fails a flip only when both runs are s…
BlivionIaG Nov 12, 2026
6238bf7
docs(rdna2): concurrency-probe noise triage: per-mode FAIL rates and …
BlivionIaG Nov 12, 2026
e645ccd
Merge feat/pciescope: pciescope PCIe/PEX88096 monitor, probe, TUI and…
BlivionIaG Nov 12, 2026
8b95256
Merge fix/cleanup-followups: follow-ups from the 2026-10-16 cleanup P…
BlivionIaG Nov 12, 2026
57b29e6
Merge docs/gqa-decode-validation-2026-11-11: GQA decode kernel passes…
BlivionIaG Nov 12, 2026
c7e466a
Merge fix/concurrency-probe-triage: concurrency probe judges noise co…
BlivionIaG Nov 12, 2026
4a971f8
Merge port/faisal-skinny-wave32: LLMM1 wave32 reduction fix and refus…
BlivionIaG Nov 12, 2026
a63a6b0
Merge cursor/trim-w4a8-dead-configs-5089: build only the launched W4A…
BlivionIaG Nov 12, 2026
d993158
feat(rdna2): opt-in LeapQuant INT8 GDN recurrent state (VLLM_RDNA_GDN…
BlivionIaG Nov 12, 2026
f6b0bac
feat(rdna2): LeapQuant GDN state under the MonoKernel
BlivionIaG Nov 12, 2026
8ba674a
perf(rdna2): one LeapQuant normalize launch per step for all GDN layers
BlivionIaG Nov 13, 2026
1e9e444
feat(rdna2): log once when a LeapQuant normalize launch covers the la…
BlivionIaG Nov 13, 2026
d879da8
fix(rdna2): share a LeapQuant normalize launch only within one KV-cac…
BlivionIaG Nov 13, 2026
7984d42
test(rdna2): cover LeapQuant normalization in padded KV pages [skip ci]
BlivionIaG Nov 13, 2026
433e745
docs(rdna2): record fixed LeapQuant receipt and acceptance caveat [sk…
BlivionIaG Nov 13, 2026
3c3f612
docs(rdna2): record LeapQuant MonoKernel-off efficiency receipt [skip…
BlivionIaG Nov 13, 2026
e200536
docs(rdna2): document LeapQuant 512-page smoke and throughput trade-o…
BlivionIaG Nov 13, 2026
66c3aca
docs(rdna2): diagnose 512-page admission pressure and record benchmar…
BlivionIaG Nov 14, 2026
ff38538
fix(rdna2): reserve LeapQuant decode growth and in-flight state
BlivionIaG Nov 14, 2026
6d6fc19
fix(bench): include first divergent prediction in decode KL
BlivionIaG Nov 14, 2026
db40b66
fix(scheduler): recover adaptive prefill fitting after cold steps
BlivionIaG Nov 14, 2026
88be1d1
feat(rdna2): qualify 512-token LeapQuant with 32-record windows
BlivionIaG Nov 14, 2026
0c523fb
feat(rdna2): add flashnext-leapquant-mtp2 recipe (512-token blocks, w…
BlivionIaG Nov 14, 2026
7b4aff7
docs(rdna2): credit LeapQuant, ReplaySSM and the RFC authors in heade…
BlivionIaG Nov 14, 2026
a60a54d
bench(rdna2): LeapQuant versus FP32 four-boot matrix, 1k/16k/32k at c…
BlivionIaG Nov 14, 2026
89413e0
docs(rdna2): LeapQuant four-boot matrix result and accepted 1k c=1 co…
BlivionIaG Nov 14, 2026
3e27433
Merge PR #168: LeapQuant GDN recurrent state, adaptive scheduler and …
BlivionIaG Nov 14, 2026
170fdd7
Merge opengfx1030/vllm-rdna rdna_extras (3e274335) into rdna_extras
claude Nov 15, 2026
976339b
feat(pciescope): know the v620-Experimentation box (four V620 behind …
claude Nov 15, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
3 changes: 3 additions & 0 deletions .buildkite/test_areas/misc.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -809,6 +809,8 @@ steps:
- tests/tools/test_check_agent_files.py
- tools/pre_commit/check_trust_remote_code.py
- tests/tools/test_check_trust_remote_code.py
- tools/rdna/port_v031/decode_kl.py
- tests/tools/rdna/test_decode_kl.py
- tests/tool_parsers
- tests/tokenizers_
- tests/parser
Expand All @@ -822,6 +824,7 @@ steps:
- pytest -v -s tools/test_check_test_tethering.py
- pytest -v -s tools/test_check_agent_files.py
- pytest -v -s tools/test_check_trust_remote_code.py
- pytest -v -s tools/rdna/test_decode_kl.py

- label: ":computer: (CPU) Reasoning + Renderers"
key: cpu-reasoning-renderers
Expand Down
1 change: 1 addition & 0 deletions CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -1668,6 +1668,7 @@ if(VLLM_GPU_LANG STREQUAL "HIP")
"csrc/rocm/moe_q_gemm_rdna2.cu"
"csrc/rocm/moe_w4a8_rdna2.cu"
"csrc/rocm/gdn_decode_rdna2.cu"
"csrc/rocm/gdn_leapquant_rdna2.cu"
"csrc/rocm/causal_conv1d_rdna2.cu"
"csrc/rocm/gdn_prefill_prep_rdna2.cu"
"csrc/rocm/gdn_prefill_kkt_rdna2.cu"
Expand Down
1 change: 1 addition & 0 deletions bench_results/2026-11-07_expert-stats-t10/H1.W1.plan.json

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5893012210173676,
"cold_max_touched_per_step": 1248.4440000000002,
"cold_mean_touched_per_step": 1035.9485000000004,
"cold_imbalance": 1.205121683172474,
"cold_max_touched_p95_per_step": 1342.0,
"hub_touched_per_step": 3739.6420000000003,
"comm_us_per_step": 3060.8855160000016,
"step_us": 12162.593763600004,
"step_us_no_spill": 15370.1375924,
"hub_spilled_per_step": 883.6785000000001,
"hub_kept_per_layer_per_hub": 59.499239583333356,
"cold_distinct_experts_per_step": 3777.7994999999996,
"cold_touches_per_step": 4143.794000000002,
"cold_replica_touch_ratio": 1.0968803399968692,
"analytic": {
"decode_hub_hit": 0.5892642691478667,
"prefill_hub_hit": 0.37635333665112103,
"cold_touched_critical_per_step": 1048.5146829787448,
"cold_touched_mean_per_step": 1041.4335205973214,
"cold_imbalance": 1.0067994377378615,
"prefill_pair_load_imbalance": 1.082725976533787,
"prefill_pair_load_imbalance_primary_only": 1.129213760781676,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 22.80844048796571
}
}
33 changes: 33 additions & 0 deletions bench_results/2026-11-07_expert-stats-t10/H1.W1.sim-on-W1.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5859268932381204,
"cold_max_touched_per_step": 1056.3465,
"cold_mean_touched_per_step": 870.0981250000002,
"cold_imbalance": 1.2140544493185752,
"cold_max_touched_p95_per_step": 1136.05,
"hub_touched_per_step": 3012.2524999999996,
"comm_us_per_step": 3060.8572776000015,
"step_us": 10642.310886799998,
"step_us_no_spill": 12744.4976812,
"hub_spilled_per_step": 586.008,
"hub_kept_per_layer_per_hub": 50.54676041666667,
"cold_distinct_experts_per_step": 2819.1364999999996,
"cold_touches_per_step": 3480.392500000001,
"cold_replica_touch_ratio": 1.2345597667938397,
"analytic": {
"decode_hub_hit": 0.5892642691478667,
"prefill_hub_hit": 0.37635333665112103,
"cold_touched_critical_per_step": 1048.5146829787448,
"cold_touched_mean_per_step": 1041.4335205973214,
"cold_imbalance": 1.0067994377378615,
"prefill_pair_load_imbalance": 1.082725976533787,
"prefill_pair_load_imbalance_primary_only": 1.129213760781676,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 22.80844048796571
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5859268932381204,
"cold_max_touched_per_step": 872.6899999999999,
"cold_mean_touched_per_step": 704.7841249999999,
"cold_imbalance": 1.2382373113185545,
"cold_max_touched_p95_per_step": 939.0,
"hub_touched_per_step": 3012.2524999999996,
"comm_us_per_step": 3060.8572776000015,
"step_us": 9664.139374,
"step_us_no_spill": 12640.910680800003,
"hub_spilled_per_step": 824.4070000000003,
"hub_kept_per_layer_per_hub": 45.58011458333334,
"cold_distinct_experts_per_step": 2819.1364999999996,
"cold_touches_per_step": 2819.1364999999996,
"cold_replica_touch_ratio": 1.0,
"analytic": {
"decode_hub_hit": 0.5892642691478667,
"prefill_hub_hit": 0.37635333665112103,
"cold_touched_critical_per_step": 1048.5146829787448,
"cold_touched_mean_per_step": 1041.4335205973214,
"cold_imbalance": 1.0067994377378615,
"prefill_pair_load_imbalance": 1.082725976533787,
"prefill_pair_load_imbalance_primary_only": 1.129213760781676,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 22.80844048796571
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5832689565643023,
"cold_max_touched_per_step": 1303.106,
"cold_mean_touched_per_step": 1085.5866250000004,
"cold_imbalance": 1.2003703527574316,
"cold_max_touched_p95_per_step": 1358.0,
"hub_touched_per_step": 3826.744,
"comm_us_per_step": 3124.4685431999983,
"step_us": 12558.720748800004,
"step_us_no_spill": 15696.760879999998,
"hub_spilled_per_step": 865.0364999999999,
"hub_kept_per_layer_per_hub": 61.70223958333333,
"cold_distinct_experts_per_step": 3947.2300000000005,
"cold_touches_per_step": 4342.3465000000015,
"cold_replica_touch_ratio": 1.1000996901624687,
"analytic": {
"decode_hub_hit": 0.5831161948826025,
"prefill_hub_hit": 0.37496054458520006,
"cold_touched_critical_per_step": 1099.1819520495553,
"cold_touched_mean_per_step": 1087.5676680550775,
"cold_imbalance": 1.0106791368809702,
"prefill_pair_load_imbalance": 1.082115580728449,
"prefill_pair_load_imbalance_primary_only": 1.1288667545901157,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 23.53432077867118
}
}
33 changes: 33 additions & 0 deletions bench_results/2026-11-07_expert-stats-t10/H1.W1.sim-on-W2.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5797586048507807,
"cold_max_touched_per_step": 1102.4745000000003,
"cold_mean_touched_per_step": 910.7797499999999,
"cold_imbalance": 1.2104732236306313,
"cold_max_touched_p95_per_step": 1152.0,
"hub_touched_per_step": 3079.6455,
"comm_us_per_step": 3124.4685431999983,
"step_us": 10988.026994800004,
"step_us_no_spill": 13008.584752799998,
"hub_spilled_per_step": 563.759,
"hub_kept_per_layer_per_hub": 52.414302083333325,
"cold_distinct_experts_per_step": 2946.4535,
"cold_touches_per_step": 3643.1189999999997,
"cold_replica_touch_ratio": 1.2364420480418237,
"analytic": {
"decode_hub_hit": 0.5831161948826025,
"prefill_hub_hit": 0.37496054458520006,
"cold_touched_critical_per_step": 1099.1819520495553,
"cold_touched_mean_per_step": 1087.5676680550775,
"cold_imbalance": 1.0106791368809702,
"prefill_pair_load_imbalance": 1.082115580728449,
"prefill_pair_load_imbalance_primary_only": 1.1288667545901157,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 23.53432077867118
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5797586048507807,
"cold_max_touched_per_step": 908.0085000000003,
"cold_mean_touched_per_step": 736.613375,
"cold_imbalance": 1.2326798980537113,
"cold_max_touched_p95_per_step": 947.0,
"hub_touched_per_step": 3079.6455,
"comm_us_per_step": 3124.4685431999983,
"step_us": 9944.440587600004,
"step_us_no_spill": 12890.931521599998,
"hub_spilled_per_step": 816.5129999999998,
"hub_kept_per_layer_per_hub": 47.14859375000001,
"cold_distinct_experts_per_step": 2946.4535,
"cold_touches_per_step": 2946.4535,
"cold_replica_touch_ratio": 1.0,
"analytic": {
"decode_hub_hit": 0.5831161948826025,
"prefill_hub_hit": 0.37496054458520006,
"cold_touched_critical_per_step": 1099.1819520495553,
"cold_touched_mean_per_step": 1087.5676680550775,
"cold_imbalance": 1.0106791368809702,
"prefill_pair_load_imbalance": 1.082115580728449,
"prefill_pair_load_imbalance_primary_only": 1.1288667545901157,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 23.53432077867118
}
}
1 change: 1 addition & 0 deletions bench_results/2026-11-07_expert-stats-t10/H1.W2.plan.json

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.586342623203738,
"cold_max_touched_per_step": 1254.1685000000004,
"cold_mean_touched_per_step": 1042.153125,
"cold_imbalance": 1.2034397536350527,
"cold_max_touched_p95_per_step": 1348.0,
"hub_touched_per_step": 3721.287,
"comm_us_per_step": 3060.8855160000016,
"step_us": 12180.009539599996,
"step_us_no_spill": 15304.859456400003,
"hub_spilled_per_step": 861.4485000000002,
"hub_kept_per_layer_per_hub": 59.57996875,
"cold_distinct_experts_per_step": 3796.154500000001,
"cold_touches_per_step": 4168.6125,
"cold_replica_touch_ratio": 1.0981145525030658,
"analytic": {
"decode_hub_hit": 0.5863125941612779,
"prefill_hub_hit": 0.378658442152118,
"cold_touched_critical_per_step": 1059.2083147414533,
"cold_touched_mean_per_step": 1047.6330101499093,
"cold_imbalance": 1.0110490071231029,
"prefill_pair_load_imbalance": 1.0683940712372875,
"prefill_pair_load_imbalance_primary_only": 1.125713669252665,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 22.80844048796571
}
}
33 changes: 33 additions & 0 deletions bench_results/2026-11-07_expert-stats-t10/H1.W2.sim-on-W1.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5829208175379823,
"cold_max_touched_per_step": 1063.079,
"cold_mean_touched_per_step": 875.5333750000002,
"cold_imbalance": 1.2142072825036507,
"cold_max_touched_p95_per_step": 1145.0,
"hub_touched_per_step": 2996.8475,
"comm_us_per_step": 3060.8572776000015,
"step_us": 10670.896846799997,
"step_us_no_spill": 12700.109381600001,
"hub_spilled_per_step": 566.147,
"hub_kept_per_layer_per_hub": 50.63959374999999,
"cold_distinct_experts_per_step": 2834.5415,
"cold_touches_per_step": 3502.133500000001,
"cold_replica_touch_ratio": 1.2355202772653007,
"analytic": {
"decode_hub_hit": 0.5863125941612779,
"prefill_hub_hit": 0.378658442152118,
"cold_touched_critical_per_step": 1059.2083147414533,
"cold_touched_mean_per_step": 1047.6330101499093,
"cold_imbalance": 1.0110490071231029,
"prefill_pair_load_imbalance": 1.0683940712372875,
"prefill_pair_load_imbalance_primary_only": 1.125713669252665,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 22.80844048796571
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5829208175379823,
"cold_max_touched_per_step": 876.5149999999999,
"cold_mean_touched_per_step": 708.635375,
"cold_imbalance": 1.2369055101151278,
"cold_max_touched_p95_per_step": 942.05,
"hub_touched_per_step": 2996.8475,
"comm_us_per_step": 3060.8572776000015,
"step_us": 9672.563677999999,
"step_us_no_spill": 12586.101280799998,
"hub_spilled_per_step": 807.2780000000001,
"hub_kept_per_layer_per_hub": 45.61603124999999,
"cold_distinct_experts_per_step": 2834.5415,
"cold_touches_per_step": 2834.5415,
"cold_replica_touch_ratio": 1.0,
"analytic": {
"decode_hub_hit": 0.5863125941612779,
"prefill_hub_hit": 0.378658442152118,
"cold_touched_critical_per_step": 1059.2083147414533,
"cold_touched_mean_per_step": 1047.6330101499093,
"cold_imbalance": 1.0110490071231029,
"prefill_pair_load_imbalance": 1.0683940712372875,
"prefill_pair_load_imbalance_primary_only": 1.125713669252665,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 22.80844048796571
}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5857012190796428,
"cold_max_touched_per_step": 1297.0895,
"cold_mean_touched_per_step": 1080.5793750000003,
"cold_imbalance": 1.2003648505691678,
"cold_max_touched_p95_per_step": 1352.0,
"hub_touched_per_step": 3841.6464999999994,
"comm_us_per_step": 3124.4826623999984,
"step_us": 12538.6836092,
"step_us_no_spill": 15746.6718044,
"hub_spilled_per_step": 883.9700000000001,
"hub_kept_per_layer_per_hub": 61.61826041666668,
"cold_distinct_experts_per_step": 3932.3275,
"cold_touches_per_step": 4322.317500000001,
"cold_replica_touch_ratio": 1.0991753611569741,
"analytic": {
"decode_hub_hit": 0.5855480391381175,
"prefill_hub_hit": 0.3774838238706881,
"cold_touched_critical_per_step": 1090.5789123246261,
"cold_touched_mean_per_step": 1082.4983665465631,
"cold_imbalance": 1.0074647186802155,
"prefill_pair_load_imbalance": 1.068314543501158,
"prefill_pair_load_imbalance_primary_only": 1.1253671224194919,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 23.53432077867118
}
}
33 changes: 33 additions & 0 deletions bench_results/2026-11-07_expert-stats-t10/H1.W2.sim-on-W2.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
{
"steps": 2000,
"hub_hit": 0.5820204817439543,
"cold_max_touched_per_step": 1097.6225000000002,
"cold_mean_touched_per_step": 906.8745,
"cold_imbalance": 1.2103356087308665,
"cold_max_touched_p95_per_step": 1147.0,
"hub_touched_per_step": 3091.6539999999995,
"comm_us_per_step": 3124.4826623999984,
"step_us": 10967.444699600004,
"step_us_no_spill": 13041.320334400003,
"hub_spilled_per_step": 578.3495,
"hub_kept_per_layer_per_hub": 52.36051041666668,
"cold_distinct_experts_per_step": 2934.445,
"cold_touches_per_step": 3627.498,
"cold_replica_touch_ratio": 1.2361785618745622,
"analytic": {
"decode_hub_hit": 0.5855480391381175,
"prefill_hub_hit": 0.3774838238706881,
"cold_touched_critical_per_step": 1090.5789123246261,
"cold_touched_mean_per_step": 1082.4983665465631,
"cold_imbalance": 1.0074647186802155,
"prefill_pair_load_imbalance": 1.068314543501158,
"prefill_pair_load_imbalance_primary_only": 1.1253671224194919,
"hub_experts_per_layer": {
"min": 130,
"mean": 137.79591836734693,
"max": 512,
"total": 6752
},
"step_rows_mean": 23.53432077867118
}
}
Loading