Skip to content

@llm-d llm-d

Change the repository type filter

All

    Repositories list

    16 repositories

    • llm-d-inference-sim

      Public
      A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
      incubating
      incubating
      Go
      •
      Apache License 2.0
      •69•109•28•4•Updated Apr 8, 2026Apr 8, 2026

    • llm-d-workload-variant-autoscaler

      Public
      Variant optimization autoscaler for distributed inference workloads
      Go
      •
      Apache License 2.0
      •45•37•96•34•Updated Apr 7, 2026Apr 7, 2026

    • llm-d

      Public
      Achieve state of the art inference performance with modern accelerators on Kubernetes
      Shell
      •
      Apache License 2.0
      •393•2.9k•162•73•Updated Apr 7, 2026Apr 7, 2026

    • llm-d-kv-cache

      Public
      Distributed KV cache scheduling & offloading libraries
      aiincubating
      aiincubating
      Go
      •
      Apache License 2.0
      •107•123•54•36•Updated Apr 7, 2026Apr 7, 2026

    • llm-d-benchmark

      Public
      llm-d benchmark scripts and tooling
      incubating
      incubating
      Python
      •
      Apache License 2.0
      •66•54•62•15•Updated Apr 6, 2026Apr 6, 2026

    • llm-d.github.io

      Public
      Website for llm-d: This repository builds the website seen at llm-d.ai
      documentationopensourceai
      documentationopensourceaidocusaurus
      JavaScript
      •
      Apache License 2.0
      •25•11•13•4•Updated Apr 6, 2026Apr 6, 2026

    • llm-d-inference-scheduler

      Public
      Inference scheduler for llm-d
      kubernetesainetworking
      kubernetesainetworkinginferencegateway-api
      Go
      •
      Apache License 2.0
      •151•163•55•20•Updated Apr 6, 2026Apr 6, 2026

    • llm-d-infra

      Public
      repo for CI and infrastructure required to maintain llm-d org member repos
      Shell
      •
      Apache License 2.0
      •4•0•35•1•Updated Apr 3, 2026Apr 3, 2026

    • llm-d-prism

      Public
      Performance analysis for distributed inference systems
      JavaScript
      •
      Apache License 2.0
      •4•2•0•0•Updated Apr 2, 2026Apr 2, 2026

    • llm-d-go-template

      Public template
      Go microservice template for llm-d repos. Use 'Use this template' to create a new Go project with standard CI, linting, Prow, and governance.
      Makefile
      •
      Apache License 2.0
      •3•0•1•4•Updated Apr 1, 2026Apr 1, 2026

    • llm-d-python-template

      Public template
      Python project template for llm-d repos. Use 'Use this template' to create a new Python project with standard CI, linting, Prow, and governance.
      Makefile
      •
      Apache License 2.0
      •2•1•1•3•Updated Mar 26, 2026Mar 26, 2026

    • llm-d-pd-utils

      Public
      Makefile
      •6•5•11•5•Updated Mar 10, 2026Mar 10, 2026

    • .github

      Public
      2•0•1•0•Updated Mar 5, 2026Mar 5, 2026

    • llm-d-routing-sidecar

      Public archive
      Incubating P/D sidecar for llm-d
      incubating
      incubating
      Go
      •
      Apache License 2.0
      •29•16•0•1•Updated Nov 13, 2025Nov 13, 2025

    • llm-d-deployer

      Public archive
      Helm charts for llm-d
      helmhelm-chartllm-d
      helmhelm-chartllm-d
      Shell
      •
      Apache License 2.0
      •56•52•34•17•Updated Jul 22, 2025Jul 22, 2025

    • llm-d-model-service

      Public archive
      Simplified model deployment on llm-d
      incubating
      incubating
      Go
      •
      Apache License 2.0
      •15•28•29•6•Updated Jul 2, 2025Jul 2, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.