Repositories list

• tpu-inference

  Public

  vllm-project/tpu-inference’s past year of commit activity
  TPU inference for vLLM, with unified JAX and PyTorch support.

  Python

  •

  Apache License 2.0

  •21•142•9•54•Updated Nov 4, 2025Nov 4, 2025

• vllm-spyre

  Public

  vllm-project/vllm-spyre’s past year of commit activity
  Community maintained hardware plugin for vLLM on Spyre

  Python

  •

  Apache License 2.0

  •26•37•6•16•Updated Nov 4, 2025Nov 4, 2025

• vllm

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  amdcudainference+ 17pytorchtransformeropenaimoellamagptmodel-serving+ 10

  Python

  •

  Apache License 2.0

  •11k•62k•1.9k•1.2k•Updated Nov 4, 2025Nov 4, 2025

• vllm-ascend

  Public

  vllm-project/vllm-ascend’s past year of commit activity
  Community maintained hardware plugin for vLLM on Ascend

  inferencetransformermodel-serving+ 6mlopsascendllmllmopsllm-servingvllm

  Python

  •

  Apache License 2.0

  •533•1.3k•646•182•Updated Nov 4, 2025Nov 4, 2025

• compressed-tensors

  Public

  vllm-project/compressed-tensors’s past year of commit activity
  A safetensors extension to efficiently store sparse quantized tensors on disk

  Python

  •

  Apache License 2.0

  •36•185•5•10•Updated Nov 4, 2025Nov 4, 2025

• guidellm

  Public

  vllm-project/guidellm’s past year of commit activity
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

  Python

  •

  Apache License 2.0

  •92•677•83•22•Updated Nov 4, 2025Nov 4, 2025

• aibrix

  Public

  vllm-project/aibrix’s past year of commit activity
  Cost-efficient and pluggable Infrastructure components for GenAI inference

  Go

  •

  Apache License 2.0

  •479•4.3k•241•19•Updated Nov 4, 2025Nov 4, 2025

• llm-compressor

  Public

  vllm-project/llm-compressor’s past year of commit activity
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  sparsitycompressionquantization

  Python

  •

  Apache License 2.0

  •276•2.2k•56•43•Updated Nov 3, 2025Nov 3, 2025

• recipes

  Public

  vllm-project/recipes’s past year of commit activity
  Common recipes to run vLLM

  Jupyter Notebook

  •

  Apache License 2.0

  •71•201•6•5•Updated Nov 3, 2025Nov 3, 2025

• speculators

  Public
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

  Python

  •

  Apache License 2.0

  •11•62•5•16•Updated Nov 3, 2025Nov 3, 2025

• semantic-router

  Public

  vllm-project/semantic-router’s past year of commit activity
  Intelligent Router for Mixture-of-Models

  pythonkubernetesrust+ 17golangmcpfine-tuningenvoyproxypii-detectionmixture-of-modelshuggingface-transformers+ 10

  Rust

  •

  Apache License 2.0

  •276•2.1k•91•26•Updated Nov 3, 2025Nov 3, 2025

• ci-infra

  Public
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

  HCL

  •

  Apache License 2.0

  •44•24•0•21•Updated Nov 3, 2025Nov 3, 2025

• vllm-gaudi

  Public

  vllm-project/vllm-gaudi’s past year of commit activity
  Community maintained hardware plugin for vLLM on Intel Gaudi

  Python

  •

  Apache License 2.0

  •59•15•0•60•Updated Nov 3, 2025Nov 3, 2025

• vllm-neuron

  Public
  Community maintained hardware plugin for vLLM on AWS Neuron

  Python

  •

  Apache License 2.0

  •0•11•0•0•Updated Oct 31, 2025Oct 31, 2025

• vllm-project.github.io

  Public

  vllm-project/vllm-project.github.io’s past year of commit activity
  JavaScript

  •36•22•0•2•Updated Oct 31, 2025Oct 31, 2025

• production-stack

  Public

  vllm-project/production-stack’s past year of commit activity
  vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

  Python

  •

  Apache License 2.0

  •312•1.9k•88•59•Updated Oct 31, 2025Oct 31, 2025

• vllm-xpu-kernels

  Public
  The vLLM XPU kernels for Intel GPU

  C++

  •

  Apache License 2.0

  •14•11•0•5•Updated Oct 31, 2025Oct 31, 2025

• FlashMLA

  Public
  C++

  •

  MIT License

  •896•7•0•3•Updated Oct 22, 2025Oct 22, 2025

• media-kit

  Public

  vllm-project/media-kit’s past year of commit activity
  vLLM Logo Assets

  3•6•0•0•Updated Oct 22, 2025Oct 22, 2025

• flash-attention

  Public
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2.1k•97•0•17•Updated Oct 19, 2025Oct 19, 2025

• DeepGEMM

  Public
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

  Cuda

  •

  MIT License

  •734•0•0•0•Updated Sep 29, 2025Sep 29, 2025

• vllm-openvino

  Public
  Python

  •

  Apache License 2.0

  •7•25•2•0•Updated Aug 18, 2025Aug 18, 2025

• rfcs

  Public
  0•1•0•0•Updated Jun 3, 2025Jun 3, 2025

• vllm-project.github.io-static

  Public archive
  HTML

  •

  MIT License

  •7•8•0•1•Updated Feb 7, 2025Feb 7, 2025

• vllm-nccl

  Public archive

  vllm-project/vllm-nccl’s past year of commit activity
  Manages vllm-nccl dependency

  Python

  •

  Apache License 2.0

  •3•17•2•0•Updated Jun 3, 2024Jun 3, 2024

• dashboard

  Public

  vllm-project/dashboard’s past year of commit activity
  vLLM performance dashboard

  Python

  •

  Apache License 2.0

  •7•37•0•0•Updated Apr 26, 2024Apr 26, 2024