Repositories list

• vllm-spyre

  Public

  vllm-project/vllm-spyre’s past year of commit activity
  Community maintained hardware plugin for vLLM on Spyre

  Python

  •

  Apache License 2.0

  •28•37•5•16•Updated Nov 24, 2025Nov 24, 2025

• tpu-inference

  Public
  TPU inference for vLLM, with unified JAX and PyTorch support.

  Python

  •

  Apache License 2.0

  •41•166•15•54•Updated Nov 24, 2025Nov 24, 2025

• vllm

  Public

  vllm-project/vllm’s past year of commit activity
  A high-throughput and memory-efficient inference and serving engine for LLMs

  amdcudainference+ 17pytorchtransformeropenaimoellamagptmodel-serving+ 10

  Python

  •

  Apache License 2.0

  •11k•64k•1.9k•1.2k•Updated Nov 24, 2025Nov 24, 2025

• semantic-router

  Public

  vllm-project/semantic-router’s past year of commit activity
  Intelligent Router for Mixture-of-Models

  pythonkubernetesrust+ 17golangmcpfine-tuningenvoyproxypii-detectionmixture-of-modelshuggingface-transformers+ 10

  Rust

  •

  Apache License 2.0

  •297•2.3k•113•37•Updated Nov 24, 2025Nov 24, 2025

• vllm-gaudi

  Public

  vllm-project/vllm-gaudi’s past year of commit activity
  Community maintained hardware plugin for vLLM on Intel Gaudi

  Python

  •

  Apache License 2.0

  •71•17•2•61•Updated Nov 24, 2025Nov 24, 2025

• guidellm

  Public
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

  Python

  •

  Apache License 2.0

  •100•718•42•15•Updated Nov 24, 2025Nov 24, 2025

• llm-compressor

  Public

  vllm-project/llm-compressor’s past year of commit activity
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  sparsitycompressionquantization

  Python

  •

  Apache License 2.0

  •292•2.3k•71•44•Updated Nov 24, 2025Nov 24, 2025

• vllm-ascend

  Public

  vllm-project/vllm-ascend’s past year of commit activity
  Community maintained hardware plugin for vLLM on Ascend

  inferencetransformermodel-serving+ 6mlopsascendllmllmopsllm-servingvllm

  Python

  •

  Apache License 2.0

  •596•1.4k•726•230•Updated Nov 24, 2025Nov 24, 2025

• vllm-xpu-kernels

  Public

  vllm-project/vllm-xpu-kernels’s past year of commit activity
  The vLLM XPU kernels for Intel GPU

  C++

  •

  Apache License 2.0

  •14•11•0•10•Updated Nov 24, 2025Nov 24, 2025

• aibrix

  Public

  vllm-project/aibrix’s past year of commit activity
  Cost-efficient and pluggable Infrastructure components for GenAI inference

  Go

  •

  Apache License 2.0

  •486•4.4k•249•24•Updated Nov 24, 2025Nov 24, 2025

• ci-infra

  Public

  vllm-project/ci-infra’s past year of commit activity
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

  HCL

  •

  Apache License 2.0

  •45•26•0•23•Updated Nov 23, 2025Nov 23, 2025

• production-stack

  Public

  vllm-project/production-stack’s past year of commit activity
  vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

  Python

  •

  Apache License 2.0

  •326•2k•91•54•Updated Nov 21, 2025Nov 21, 2025

• speculators

  Public

  vllm-project/speculators’s past year of commit activity
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

  Python

  •

  Apache License 2.0

  •15•128•9•17•Updated Nov 21, 2025Nov 21, 2025

• flash-attention

  Public
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2.2k•102•0•18•Updated Nov 21, 2025Nov 21, 2025

• vllm-project.github.io

  Public

  vllm-project/vllm-project.github.io’s past year of commit activity
  JavaScript

  •43•24•0•1•Updated Nov 21, 2025Nov 21, 2025

• compressed-tensors

  Public

  vllm-project/compressed-tensors’s past year of commit activity
  A safetensors extension to efficiently store sparse quantized tensors on disk

  Python

  •

  Apache License 2.0

  •39•210•5•14•Updated Nov 19, 2025Nov 19, 2025

• vllm-neuron

  Public

  vllm-project/vllm-neuron’s past year of commit activity
  Community maintained hardware plugin for vLLM on AWS Neuron

  Python

  •0•13•0•1•Updated Nov 18, 2025Nov 18, 2025

• recipes

  Public
  Common recipes to run vLLM

  Jupyter Notebook

  •

  Apache License 2.0

  •86•242•7•6•Updated Nov 13, 2025Nov 13, 2025

• FlashMLA

  Public

  vllm-project/FlashMLA’s past year of commit activity
  C++

  •

  MIT License

  •905•8•0•3•Updated Oct 22, 2025Oct 22, 2025

• media-kit

  Public

  vllm-project/media-kit’s past year of commit activity
  vLLM Logo Assets

  3•6•0•0•Updated Oct 22, 2025Oct 22, 2025

• DeepGEMM

  Public

  vllm-project/DeepGEMM’s past year of commit activity
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

  Cuda

  •

  MIT License

  •752•0•0•0•Updated Sep 29, 2025Sep 29, 2025

• vllm-openvino

  Public
  Python

  •

  Apache License 2.0

  •9•26•3•0•Updated Aug 18, 2025Aug 18, 2025

• rfcs

  Public
  0•1•0•0•Updated Jun 3, 2025Jun 3, 2025

• vllm-project.github.io-static

  Public archive

  vllm-project/vllm-project.github.io-static’s past year of commit activity
  HTML

  •

  MIT License

  •7•9•0•1•Updated Feb 7, 2025Feb 7, 2025

• vllm-nccl

  Public archive

  vllm-project/vllm-nccl’s past year of commit activity
  Manages vllm-nccl dependency

  Python

  •

  Apache License 2.0

  •3•17•2•0•Updated Jun 3, 2024Jun 3, 2024

• dashboard

  Public
  vLLM performance dashboard

  Python

  •

  Apache License 2.0

  •7•38•0•0•Updated Apr 26, 2024Apr 26, 2024