fix(megatron-fsdp): build expt_device_mesh only for MoE models#3831

xuwchen wants to merge 3 commits intoNVIDIA:mainNVIDIA/Megatron-LM:mainfrom

xuwchen:fix_expt_device_meshxuwchen/Megatron-LM:fix_expt_device_meshCopy head branch name to clipboard