Repositories list

• gpustack

  Public
  Performance-optimized AI inference on your GPUs. Unlock superior throughput by selecting and tuning engines like vLLM or SGLang.

  cudainferenceopenai+ 15

  cudainferenceopenaillamamaasrocmascendllmllm-servingvllm+ 8

  Python

  •

  Apache License 2.0

  •472•4.6k•483•30•Updated Mar 14, 2026Mar 14, 2026

• runtime

  Public
  Provides a unified interface to detect GPU resources and manages GPU workloads.

  Python

  •

  Apache License 2.0

  •13•11•0•3•Updated Mar 13, 2026Mar 13, 2026

• gpustack-ui

  Public
  TypeScript

  •

  Apache License 2.0

  •55•75•2•5•Updated Mar 13, 2026Mar 13, 2026

• runner

  Public
  Collection of Dockerfiles to build images for various inference services across different accelerated backends.

  Dockerfile

  •

  Apache License 2.0

  •9•9•0•0•Updated Mar 13, 2026Mar 13, 2026

• gpustack.github.io

  Public
  HTML

  •2•1•0•0•Updated Mar 7, 2026Mar 7, 2026

• benchmark-runner

  Public
  Python

  •

  Apache License 2.0

  •2•2•1•0•Updated Mar 6, 2026Mar 6, 2026

• gpustack-higress-plugin

  Public
  Go

  •2•1•0•0•Updated Feb 28, 2026Feb 28, 2026

• community-inference-backends

  Public
  Community Inference Backends for GPUStack V2

  Python

  •

  Apache License 2.0

  •7•8•0•1•Updated Feb 13, 2026Feb 13, 2026

• gguf-parser-go

  Public
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

  gollama-cppgguf+ 2

  gollama-cppggufstable-diffusion-cppllama-box

  Go

  •

  MIT License

  •24•249•0•0•Updated Feb 11, 2026Feb 11, 2026

• .github

  Public
  Meta-Github repository for all GPUStack repositories.

  github-metadata

  github-metadata

  Apache License 2.0

  •4•1•0•0•Updated Feb 4, 2026Feb 4, 2026

• vox-box

  Public
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

  pythontext-to-speechtts+ 5

  pythontext-to-speechttsspeech-to-textsttaudio-processingasropenai-compatible-api

  Python

  •

  Apache License 2.0

  •32•200•15•1•Updated Dec 23, 2025Dec 23, 2025

• llama-box

  Public archive
  LM inference server implementation based on *.cpp.

  cpptransformerdiffusion+ 2

  cpptransformerdiffusionggufopenai-compatible-api

  C++

  •

  MIT License

  •28•296•2•0•Updated Nov 24, 2025Nov 24, 2025

• gpustack-helper

  Public
  Python

  •

  Apache License 2.0

  •2•1•1•0•Updated Aug 26, 2025Aug 26, 2025

• fastfetch

  Public
  Like neofetch, but much faster because written mostly in C.

  C

  •

  MIT License

  •710•2•0•0•Updated Oct 24, 2024Oct 24, 2024

• gguf-packer-go

  Public
  Deliver LLMs of GGUF format via Dockerfile.

  gollamagguf

  gollamagguf

  Go

  •

  MIT License

  •4•15•0•0•Updated Oct 24, 2024Oct 24, 2024