Repositories list

• vllm-project.github.io

  Public

  vllm-project/vllm-project.github.io’s past year of commit activity
  JavaScript

  •51•25•0•2•Updated Dec 15, 2025Dec 15, 2025

• vllm-ascend

  Public

  vllm-project/vllm-ascend’s past year of commit activity
  Community maintained hardware plugin for vLLM on Ascend

  inferencetransformermodel-serving+ 6mlopsascendllmllmopsllm-servingvllm

  Python

  •

  Apache License 2.0

  •659•1.5k•815•280•Updated Dec 15, 2025Dec 15, 2025

• vllm

  Public

  vllm-project/vllm’s past year of commit activity
  A high-throughput and memory-efficient inference and serving engine for LLMs

  amdcudainference+ 17pytorchtransformeropenaimoellamagptmodel-serving+ 10

  Python

  •

  Apache License 2.0

  •12k•65k•1.9k•1.3k•Updated Dec 15, 2025Dec 15, 2025

• vllm-omni

  Public

  vllm-project/vllm-omni’s past year of commit activity
  A framework for efficient model inference with omni-modality models

  inferencepytorchtransformer+ 6image-generationdiffusionmodel-servingmultimodalvideo-generationaudio-generation

  Python

  •

  Apache License 2.0

  •115•902•60•34•Updated Dec 15, 2025Dec 15, 2025

• vllm-xpu-kernels

  Public

  vllm-project/vllm-xpu-kernels’s past year of commit activity
  The vLLM XPU kernels for Intel GPU

  C++

  •

  Apache License 2.0

  •15•12•1•4•Updated Dec 15, 2025Dec 15, 2025

• semantic-router

  Public

  vllm-project/semantic-router’s past year of commit activity
  Intelligent Router for Mixture-of-Models

  pythonkubernetesrust+ 17golangmcpfine-tuningenvoyproxypii-detectionmixture-of-modelshuggingface-transformers+ 10

  Go

  •

  Apache License 2.0

  •307•2.4k•94•34•Updated Dec 15, 2025Dec 15, 2025

• tpu-inference

  Public

  vllm-project/tpu-inference’s past year of commit activity
  TPU inference for vLLM, with unified JAX and PyTorch support.

  Python

  •

  Apache License 2.0

  •59•194•17•75•Updated Dec 15, 2025Dec 15, 2025

• vllm-gaudi

  Public

  vllm-project/vllm-gaudi’s past year of commit activity
  Community maintained hardware plugin for vLLM on Intel Gaudi

  Python

  •

  Apache License 2.0

  •80•19•1•66•Updated Dec 15, 2025Dec 15, 2025

• llm-compressor

  Public

  vllm-project/llm-compressor’s past year of commit activity
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  sparsitycompressionquantization

  Python

  •

  Apache License 2.0

  •316•2.4k•74•50•Updated Dec 15, 2025Dec 15, 2025

• guidellm

  Public

  vllm-project/guidellm’s past year of commit activity
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

  Python

  •

  Apache License 2.0

  •107•753•44•16•Updated Dec 15, 2025Dec 15, 2025

• compressed-tensors

  Public

  vllm-project/compressed-tensors’s past year of commit activity
  A safetensors extension to efficiently store sparse quantized tensors on disk

  Python

  •

  Apache License 2.0

  •45•215•3•14•Updated Dec 14, 2025Dec 14, 2025

• ci-infra

  Public

  vllm-project/ci-infra’s past year of commit activity
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

  HCL

  •

  Apache License 2.0

  •50•27•0•29•Updated Dec 14, 2025Dec 14, 2025

• vLLM-in-PyTorch-Conference-2025

  Public

  vllm-project/vLLM-in-PyTorch-Conference-2025’s past year of commit activity
  0•7•0•0•Updated Dec 14, 2025Dec 14, 2025

• router

  Public

  vllm-project/router’s past year of commit activity
  A high-performance and light-weight router for vLLM large scale deployment

  Rust

  •

  Apache License 2.0

  •5•25•1•5•Updated Dec 14, 2025Dec 14, 2025

• aibrix

  Public

  vllm-project/aibrix’s past year of commit activity
  Cost-efficient and pluggable Infrastructure components for GenAI inference

  Go

  •

  Apache License 2.0

  •495•4.5k•265•28•Updated Dec 13, 2025Dec 13, 2025

• vllm-spyre

  Public

  vllm-project/vllm-spyre’s past year of commit activity
  Community maintained hardware plugin for vLLM on Spyre

  Python

  •

  Apache License 2.0

  •30•37•4•12•Updated Dec 12, 2025Dec 12, 2025

• vllm-metal

  Public

  vllm-project/vllm-metal’s past year of commit activity
  Community maintained hardware plugin for vLLM on Apple Silicon

  Apache License 2.0

  •0•1•1•0•Updated Dec 12, 2025Dec 12, 2025

• recipes

  Public

  vllm-project/recipes’s past year of commit activity
  Common recipes to run vLLM

  Jupyter Notebook

  •

  Apache License 2.0

  •102•278•10•26•Updated Dec 12, 2025Dec 12, 2025

• speculators

  Public

  vllm-project/speculators’s past year of commit activity
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

  Python

  •

  Apache License 2.0

  •21•156•8•10•Updated Dec 11, 2025Dec 11, 2025

• flash-attention

  Public

  vllm-project/flash-attention’s past year of commit activity
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2.2k•104•0•16•Updated Dec 11, 2025Dec 11, 2025

• vllm-neuron

  Public

  vllm-project/vllm-neuron’s past year of commit activity
  Community maintained hardware plugin for vLLM on AWS Neuron

  Python

  •3•15•0•1•Updated Dec 6, 2025Dec 6, 2025

• vllm-openvino

  Public

  vllm-project/vllm-openvino’s past year of commit activity
  Python

  •

  Apache License 2.0

  •10•27•2•0•Updated Dec 4, 2025Dec 4, 2025

• production-stack

  Public

  vllm-project/production-stack’s past year of commit activity
  vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

  Python

  •

  Apache License 2.0

  •337•2k•93•54•Updated Nov 30, 2025Nov 30, 2025

• FlashMLA

  Public

  vllm-project/FlashMLA’s past year of commit activity
  C++

  •

  MIT License

  •914•9•0•3•Updated Oct 22, 2025Oct 22, 2025

• media-kit

  Public

  vllm-project/media-kit’s past year of commit activity
  vLLM Logo Assets

  4•6•0•0•Updated Oct 22, 2025Oct 22, 2025

• DeepGEMM

  Public

  vllm-project/DeepGEMM’s past year of commit activity
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

  Cuda

  •

  MIT License

  •774•0•0•0•Updated Sep 29, 2025Sep 29, 2025

• rfcs

  Public
  0•1•0•0•Updated Jun 3, 2025Jun 3, 2025

• vllm-project.github.io-static

  Public archive

  vllm-project/vllm-project.github.io-static’s past year of commit activity
  HTML

  •

  MIT License

  •7•9•0•1•Updated Feb 7, 2025Feb 7, 2025

• vllm-nccl

  Public archive

  vllm-project/vllm-nccl’s past year of commit activity
  Manages vllm-nccl dependency

  Python

  •

  Apache License 2.0

  •3•17•2•0•Updated Jun 3, 2024Jun 3, 2024

• dashboard

  Public

  vllm-project/dashboard’s past year of commit activity
  vLLM performance dashboard

  Python

  •

  Apache License 2.0

  •8•40•0•0•Updated Apr 26, 2024Apr 26, 2024