Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 65.4k 12k

2. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 95.9k 26.2k

3. LazyAGI/LazyLLM LazyAGI/LazyLLM Public

   Easiest and laziest way for building multi-agent LLMs applications.

   Python 3.5k 350

4. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 41k 4.7k

5. deepseek-ai/DeepGEMM deepseek-ai/DeepGEMM Public

   DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

   Cuda 6k 774

6. yewentao256.github.io yewentao256.github.io Public

   wentao.site / Hugo Template / A template repository for Hugo based blog

   49 3