Repository navigation
feat(hip/gfx1201): RDNA4 DS4 WMMA12 index score, IQ dequant, and MM3 kernel uplifts - #984
Draft
nicholas631 wants to merge 2 commits into
Draft
nicholas631 wants to merge 2 commits into
nicholas631 wants to merge 2 commits into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Clean Draft PR rebased onto Project Maya
v1.1.63(6651b5b) targeting AMD RDNA4 (gfx1201) and shared HIP/MM3 kernel parity, with zero host-specific recipes or benchmark artifacts.Modified Files
src/ds4/ds4_kernels.cu: RDNA4gfx12WMMA12 index score (DS4_INDEX_TC=1) uplift.src/ds4/ds4_iq.cu: RDNA4 wave32 / HIP IQ dequantization uplift.src/kernels/cuda/iq_kernels.cu: AllowQ8_0down-projection innative_expert_grouped.src/mm3/mm3_kernels.cu,src/mm3/mm3_kernels.cuh,src/mm3/mm3_gguf.cu,tests/mm3_gguf_test.cu: MM3 RDNA4 kernel dispatch andQ8_0GGUF parity.Validation & Numerical Parity
./build-hip/mm3_kernels_test,./build-hip/mm3_gguf_test,./build-hip/iq_mmvq_parity_test,./build-hip/glm_attn_bench --parity-onlymm3_kernels_test,mm3_gguf_test,iq_mmvq_parity_test,suffix_drafter_test,mtp_rows_testall PASS (max_abs = 0.000/ within FP16 WMMA tolerance).sm_86,gfx906) unaffected.