Skip to content

Add MoE depth MuP LR sweep#5179

Draft
WhenWen wants to merge 31 commits intomainfrom
research/moe-depth-mup-lr-sweep
Draft

Add MoE depth MuP LR sweep#5179
WhenWen wants to merge 31 commits intomainfrom
research/moe-depth-mup-lr-sweep

Commits

Commits on Apr 25, 2026

Commits on Apr 26, 2026

Commits on Apr 27, 2026