Repositories list

• LMCache

  Public
  Supercharge Your LLM with the Fastest KV Cache Layer

  fastamdcuda+ 7

  fastamdcudainferencepytorchspeedrocmkv-cachellmvllm

  Python

  •

  Apache License 2.0

  •1k•7.7k•126•135•Updated Mar 14, 2026Mar 14, 2026

• LMCache-Ascend

  Public
  LMCache on Ascend

  Python

  •

  Apache License 2.0

  •22•54•34•5•Updated Mar 12, 2026Mar 12, 2026

• kvcache-view

  Public
  KV cache visualizations

  HTML

  •

  Other

  •0•6•0•0•Updated Mar 6, 2026Mar 6, 2026

• lmcache-agent-trace

  Public
  Agent application/benchmark/workload traces should be placed here.

  HTML

  •

  Apache License 2.0

  •4•7•0•0•Updated Feb 23, 2026Feb 23, 2026

• LMBenchmark

  Public

  LMCache/LMBenchmark’s past year of commit activity
  Systematic and comprehensive benchmarks for LLM systems.

  Python

  •

  Apache License 2.0

  •24•51•2•0•Updated Jan 28, 2026Jan 28, 2026

• lmcache_redis

  Public
  zero copy python sdk

  Python

  •1•1•0•1•Updated Jan 21, 2026Jan 21, 2026

• lmcache_frontend

  Public
  the frontend of lmcache

  Python

  •7•17•5•1•Updated Dec 31, 2025Dec 31, 2025

• LMBench

  Public

  LMCache/LMBench’s past year of commit activity
  Modular Serving Engine x Workload Generator Benchmarking Tool

  Python

  •

  Apache License 2.0

  •3•8•5•0•Updated Nov 19, 2025Nov 19, 2025

• lmcache.github.io

  Public

  LMCache/lmcache.github.io’s past year of commit activity
  LMCache official blog

  HTML

  •

  MIT License

  •6•1•0•0•Updated Oct 29, 2025Oct 29, 2025

• demo-baseline-benchmarking

  Public
  JavaScript

  •0•1•0•0•Updated Sep 26, 2025Sep 26, 2025

• lmcache-agentic

  Public
  Python

  •1•5•0•0•Updated Sep 8, 2025Sep 8, 2025

• LMIgnite

  Public
  Shell

  •

  Apache License 2.0

  •4•28•0•0•Updated Jul 29, 2025Jul 29, 2025

• hardware-diagnostic

  Public
  View Information about hardware

  Python

  •0•4•0•0•Updated Jul 25, 2025Jul 25, 2025

• LMCache-Examples

  Public
  Jupyter Notebook

  •1•7•0•0•Updated Jul 9, 2025Jul 9, 2025

• inference-engine-arena

  Public
  Postman & Chatbot Arena for inference benchmarking.

  Python

  •

  Apache License 2.0

  •0•1•0•0•Updated May 14, 2025May 14, 2025

• demo

  Public
  Python

  •

  Apache License 2.0

  •12•27•5•1•Updated Apr 17, 2025Apr 17, 2025

• lmcache-tests

  Public
  Python

  •

  Apache License 2.0

  •8•9•8•2•Updated Apr 2, 2025Apr 2, 2025

• lmcache-vllm

  Public
  The driver for LMCache core to run in vLLM

  Python

  •

  Apache License 2.0

  •33•62•5•6•Updated Feb 4, 2025Feb 4, 2025

• torchac_cuda

  Public
  Cuda

  •

  Apache License 2.0

  •6•5•2•4•Updated Jan 30, 2025Jan 30, 2025

• lmcache-server

  Public
  Python

  •

  Apache License 2.0

  •4•6•0•0•Updated Sep 17, 2024Sep 17, 2024