Popular repositories Loading

1. DeepSpeed DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 41k 4.7k

2. DeepSpeedExamples DeepSpeedExamples Public

   Example models using DeepSpeed

   Python 6.7k 1.1k

3. Megatron-DeepSpeed Megatron-DeepSpeed Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 2.2k 364

4. DeepSpeed-MII DeepSpeed-MII Public

   MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

   Python 2.1k 186

5. DeepSpeed-Kernels DeepSpeed-Kernels Public

   C++ 71 17

6. deepspeed-gpt-neox deepspeed-gpt-neox Public

   Forked from EleutherAI/gpt-neox

   An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

   Python 20 3