Skip to content

[megatron] 3/n towards Kimi K2.6: skip MLA THD value pad on sm100+ to keep fused attention trainable - #2025

Merged
erictang000 merged 6 commits into
NovaSky-AI:mainfrom
casper-hansen:casper/kimi-3-mla-vpad-sm100
Sep 3, 2026
Merged

[megatron] 3/n towards Kimi K2.6: skip MLA THD value pad on sm100+ to keep fused attention trainable#2025
erictang000 merged 6 commits into
NovaSky-AI:mainfrom
casper-hansen:casper/kimi-3-mla-vpad-sm100

lint

f751223
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 error and 1 warning
skyrl_gpu_tests
failed Sep 3, 2026 in 24s