Skip to content

Fix silent gradient-bucket drop on CPU in ZeRO-1/2 non-contiguous reduction - #8382

Open
delock wants to merge 6 commits into
deepspeedai:masterfrom
delock:fix/cpu-gradient-bucket-drop
Open

Fix silent gradient-bucket drop on CPU in ZeRO-1/2 non-contiguous reduction#8382
delock wants to merge 6 commits into
deepspeedai:masterfrom
delock:fix/cpu-gradient-bucket-drop

Exclude non-strided tensor layouts from ZeRO-1/2 reduction buckets

6040bbc
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Sep 7, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO