Skip to content

[megatron] 3/n towards Kimi K2.6: skip MLA THD value pad on sm100+ to keep fused attention trainable - #2025

Merged
erictang000 merged 6 commits into
NovaSky-AI:mainfrom
casper-hansen:casper/kimi-3-mla-vpad-sm100
Sep 3, 2026
Merged

[megatron] 3/n towards Kimi K2.6: skip MLA THD value pad on sm100+ to keep fused attention trainable#2025
erictang000 merged 6 commits into
NovaSky-AI:mainfrom
casper-hansen:casper/kimi-3-mla-vpad-sm100

Commits

Commits on Aug 13, 2026

Commits on Aug 19, 2026

Commits on Sep 3, 2026