Help with deepspeed CPU only installation

[sabre-code]

I am not able install deepspeed for CPU setup. Need some documentation reference for guide on CPU installation.

[vincere-mori]

The env var you need is DS_BUILD_OPS=0:

DS_BUILD_OPS=0 pip install deepspeed

This skips all CUDA extension compilation. If pip still tries to build something in your environment, add --no-build-isolation:

DS_BUILD_OPS=0 pip install deepspeed --no-build-isolation

That's basically it. The docs bury this info but DS_BUILD_OPS=0 is the standard way to get a CPU-only install.

[sowndappan5]

Thanks for the clarification.

I noticed the README already points users to the Advanced Installation Instructions for pre-installing or disabling ops. Is that the recommended documentation for CPU-only installations as well?

If so, it might be worth explicitly mentioning DS_BUILD_OPS=0 in the CPU installation section to make it easier for users to discover.