Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 86.5k 19.5k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.4k 7.2k

3. iree-org/iree iree-org/iree Public

   A retargetable MLIR-based machine learning compiler and runtime toolkit.

   C++ 3.8k 954

4. mlir-dsp mlir-dsp Public

   DSP pipeline with MLIR

   MLIR

5. testcuda testcuda Public

   C++

6. rocm-libraries rocm-libraries Public

   Forked from ROCm/rocm-libraries

   monorepo for rocm libraries

   Assembly