Skip to content

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism#8167

Open
delock wants to merge 3 commits into
deepspeedai:masterfrom
delock:gma/allow-autotp-with-zero3
Open

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism#8167
delock wants to merge 3 commits into
deepspeedai:masterfrom
delock:gma/allow-autotp-with-zero3