Pinned Loading

1. tpu-inference tpu-inference Public

   Forked from vllm-project/tpu-inference

   Python

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 77.6k 15.9k

3. NVIDIA-NeMo/NeMo NVIDIA-NeMo/NeMo Public

   A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

   Python 17.1k 3.4k

4. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Python 5.5k 916

5. NVIDIA/tilus NVIDIA/tilus Public

   Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.

   Python 477 24