Skip to content

feat(hip/gfx906): DS4 SDOT4 index score, FP16 DSpark FC16, row-local GLM prefill, and Q8_0 MM3 GGUF parity - #889

Draft
nicholas631 wants to merge 4 commits into
mw00:mainfrom
nicholas631:feat/hip-gfx906-minimax-ep4-ds4-dspark8
Draft

nicholas631 wants to merge 4 commits into
mw00:mainfrom
nicholas631:feat/hip-gfx906-minimax-ep4-ds4-dspark8

Conversation

@nicholas631

@nicholas631 nicholas631 commented Nov 6, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Rebased cleanly onto Project Maya v1.1.63 (6651b5b) with zero host-specific recipes or benchmark artifacts.

Modified Files

  • CMakeLists.txt: Register glm_prefill_row_local_test.
  • docs/SETTINGS.md: Document MAYA_GLM_PREFILL_ROW_LOCAL.
  • src/core/glm_fast_path.cu, src/core/glm_fast_state.hpp, src/core/glm_prefill.cu, src/core/glm_prefill_row_local.hpp: Row-local GLM prefill path (MAYA_GLM_PREFILL_ROW_LOCAL) avoiding large shared-memory staging on wave64 gfx906.
  • src/ds4/ds4_kernels.cu: Add DS4_INDEX_SDOT4=1 index_score_sdot4_kernel for __gfx906__ guarded to hd == 128.
  • src/kernels/cuda/iq_kernels.cu: Allow Q8_0 down-projection in native_expert_grouped.
  • src/mm3/mm3_dspark.cu: Add gfx906 FP16 DSpark FC16 (MAYA_MM3_DSPARK_FC16) path.
  • src/mm3/mm3_gguf.cu, tests/mm3_gguf_test.cu: Add Q8_0 MM3 GGUF parity support.
  • tests/glm_prefill_row_local_test.cpp: Unit + numerical parity test for row-local IQ3_S gate/up and IQ4_XS down prefill.

Validation & Numerical Parity

  • Reproducer: ./build-gfx906/glm_prefill_row_local_test, ./build-gfx906/ds4_gguf_test, ./build-gfx906/iq_mmvq_parity_test
  • Numerical parity: bit-exact / max_abs = 0.000 on hip_intrinsics, ds4_gguf_test, iq_mmvq_parity_test, and glm_prefill_row_local_test (PASS).
  • Non-target architectures (sm_86, gfx1201) unaffected behind __gfx906__ / opt-in runtime guards.

@nicholas631
nicholas631 force-pushed the feat/hip-gfx906-minimax-ep4-ds4-dspark8 branch from 3606727 to 5be320c Compare November 14, 2026 04:29
@nicholas631 nicholas631 changed the title feat(hip/gfx906): activate 4-helper EP DMA pipelines on MiniMax-M3.1 and calibrate DSpark K=8 horizon on MI50 feat(hip/gfx906): DS4 SDOT4 index score, FP16 DSpark FC16, row-local GLM prefill, and Q8_0 MM3 GGUF parity Nov 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant