[DO NOT MERGE] MLPERF HOTFIX: Default gradient communication dtype to BF16.#3807

cspades wants to merge 1 commit intoNVIDIA:mainNVIDIA/Megatron-LM:mainfrom

cspades:cye/patch-grad-comm-wgrad-fusecspades/Megatron-LM:cye/patch-grad-comm-wgrad-fuseCopy head branch name to clipboard