[sync] Save memory using main_param for moe in param_l2_norm#2091
Draft
ananthsub wants to merge 1 commit intoNVIDIA-NeMo:mainfrom
Draft
[sync] Save memory using main_param for moe in param_l2_norm#2091ananthsub wants to merge 1 commit intoNVIDIA-NeMo:mainfrom
ananthsub wants to merge 1 commit intoNVIDIA-NeMo:mainfrom