fix: fp32 master weights for custom MoE models under FSDP2#1896

Draft

zpqiu wants to merge 10 commits intomainfrom

zpqiu/fp32-master-weights-custom-moe

Commits on Apr 17, 2026

fix(moe): plumb mp_policy end-to-end and cast expert weights in forward

zpqiu
and
claude
committed
fix(checkpoint): preserve model param dtype across initialize_weights()

zpqiu
and
claude
committed
fix(models): thread config.torch_dtype explicitly in custom MoE models

zpqiu
and
claude
committed
fix(models): thread dtype in remaining text-only custom MoE models

zpqiu
and
claude
committed
fix(models): thread dtype + propagate to sub-configs for VL MoE models

zpqiu
and
claude
committed
Merge branch 'main' into zpqiu/fp32-master-weights-custom-moe
akoumpa
authored

Commits on Apr 18, 2026

Merge branch 'main' into zpqiu/fp32-master-weights-custom-moe
akoumpa
authored

Commits on Apr 19, 2026

Commits on Apr 20, 2026

fix(shared): dtype_from_str falls back to default for non-str/non-dtype

zpqiu
and
claude
committed