Skip to content

Fix-FP16-ZeRO-Stage-0-loss-Scaling-In-engine.backward() - #8393

Open
etemadiamd wants to merge 1 commit into
deepspeedai:masterfrom
etemadiamd:fix/fp16_zero0_loss_scaling_engine_backward
Open

Fix-FP16-ZeRO-Stage-0-loss-Scaling-In-engine.backward()#8393
etemadiamd wants to merge 1 commit into
deepspeedai:masterfrom
etemadiamd:fix/fp16_zero0_loss_scaling_engine_backward

Fix fp16 ZeRO stage-0 loss scaling in engine.backward()

e614064
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 2, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO