Add Muon Optimizer [cherry-pick from dev]#78679

Merged

sneaxiy merged 7 commits intoPaddlePaddle:release/3.3from

xxyux:release/3.3

Apr 15, 2026

Commits on Apr 14, 2026

feat: add Muon optimizer with distributed sharding support

xxyux
and
claude
committed
fix: remove MuonShardingOptimizer from meta_optimizer_names

xxyux
and
claude
committed
test: fix hybrid_parallel_sharding_muon_model to work with new clear_grad

xxyux
and
claude
committed
fix: refactor clear_grad to handle tensor_fusion and iterate over full parameter list

xxyux
and
claude
committed
feat: add MLA support and param storage clear for Muon optimizer

xxyux
and
claude
committed
optimization for reduce-gradient by applying comm_buffer to 2d params
xxyux
committed

Commits on Apr 15, 2026

update CI
xxyux
committed