Repository navigation
docs(rdna2): how to reproduce the MonoKernel (#94) numbers - #120
Draft
BlivionIaG wants to merge 3 commits into
Draft
BlivionIaG wants to merge 3 commits into
BlivionIaG wants to merge 3 commits into
Conversation
…t on the current tip The procedure stays pinned to 1c1426d. Add what was verified against rdna_extras 1136bb9 (paths, ab_table.py rebuilds ab_table.md byte for byte, PRINT=1 dry runs at the pin and the tip, bench and serve flags) and what the tip does differently (recipes, serve_validate.sh, REFUSED_GPUS, the MonoKernel itself, the 2026-11-05 mono + W4A8 A/B that disagrees in sign). Signed-off-by: BlivionIaG <kev29lt@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
docs/rdna2/monokernel-reproduce.md, a step-by-step guide to rerunning the same-session--monokerneloff/on A/B from #94 (merged as1c1426d585).Docs only. No code change.
Refresh 2026-11-11 (merged
origin/rdna_extras1136bb952binto the branch, no force)The branch was 2,306 commits behind, and #94's tree is 2,332 commits behind the tip. The merge was clean. The procedure itself is unchanged: it pins
1c1426d585(an ancestor of the tip) and must not be run on a newer tip. What was stale was the doc's claim about how far behind it is and its silence on what the tip does differently. New section "What this pins, and what it does not" (commitacc1697114) says:1c1426d585, the two recipes as they were at that commit, venvvenv-7.14.0_0.31.0-final, TunableOp profilerocm7.14-rocblas5.5, model snapshot0939125b..., PLE snapshot4f861b63..., and the recorded table (one serve per arm).ab_table.py(pin and tip versions) rebuildsab_table.mdbyte for byte from the recordedserve-*directories with the four-directory command in the doc (the doc used to say the command line was "not recorded"; it is now verified);PRINT=1 EXTRA_ARGS="--monokernel" tools/rdna/serve_rdna.sh RECIPE=flashnext-mtp{0,2}exits 0 at the pin and at the tip on the bench box and prints--monokerneland therocm7.14-rocblas5.5TunableOp line;bench serveflags of step 4 are accepted bybench serve --help=allat the tip, and all 11 serve flags,--monokernelincluded, appear inserve --help=all(CPU-only runs). At the pin the CLI aborts intorch._C._cuda_initon a CPU-only run, so the pin was read, not run.flashnext-mtp2.env(one-shot AR 256 KiB,W4A8_SDOT4=1,W4A8_BLOCK_M=8,W4A8_KBLOCK=-1,SMALLM_GEMM_MAX_BYTES), both recipesVLLM_GDN_HIP_PREFILL=1,serve_validate.shquiet windows, boot lock, KFD-eviction check andREFUSED_GPUS(the old HIP 0/1caseblock),serve_2a.shGMEM=0.92, and the MonoKernel itself (K2 dense MTP FFN, MTP routing, fail-stop, quantized-KV refusal, W4A8 coexistence, expert offload).docs/rdna2/mono-w4a8-2026-11-05.md(tree5b8d1e5570, HIP 2-5) found mono + W4A8 slower than production at an equalGPU_MAX_HW_QUEUES=4. The reproduce doc records what [RDNA2] MonoKernel decode for Qwen3.8-Flash-Next on gfx1030 (--monokernel) #94 measured at its pin and says it does not resolve that.pre-commit (markdownlint, typos, ...) passes. Nothing was run on a GPU.
Original description
The guide comes from the #94 description and the raw run in the infrastructure repo,
bench_results/2026-10-16_mono-layout/(ab.sh,ab.out,ab2.out,ab_table.md,build.sh,pytest*.log,serve-*/). It covers:ab_table.md. It matches the PR table except for rounding. It also says which serves each row comes from: the MTP2 rows come from theab2rerun.1c1426d585(the run logged no SHA; the evidence is in the doc), venv name, TunableOp profilerocm7.14-rocblas5.5/ rocBLASf30bb442e9b5, the in-place native build, model and PLE snapshots.GPU_MAX_HW_QUEUES=4,HSA_FORCE_FINE_GRAIN_PCIE=1,ROCPROFILER_REGISTER_ENABLED=0, ...) and the serve shape.--monokernel,VLLM_ROCM_MONO_DECODE=1), the bench cells, and howbench_metrics.pycomputes the four metrics.33892a9af4MTP2 boot refusal, host-specific driver guards).Items that the sources do not record are marked not recorded.
Validation status
bench_results/2026-10-16_mono-layout/