Skip to content
Change the repository type filter

All

    Repositories list

    • Python
      114110Updated Feb 3, 2026Feb 3, 2026
    • A python-based LLM performance simulator with vLLM, notable for its lightweight design, easy scalability.
      Python
      2472Updated Jan 27, 2026Jan 27, 2026
    • vllm-omni

      Public
      A framework for efficient model inference with omni-modality models
      Python
      3950780Updated Jan 15, 2026Jan 15, 2026
    • Community maintained hardware plugin for vLLM on Ascend
      Python
      811455Updated Jan 7, 2026Jan 7, 2026
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      13k7287Updated Jan 7, 2026Jan 7, 2026
    • Mooncake

      Public
      Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
      C++
      549001Updated Nov 27, 2025Nov 27, 2025
    • yalantinglibs

      Public
      A collection of modern C++ libraries, include coro_http, coro_rpc, compile-time reflection, struct_pack, struct_json, struct_xml, struct_pb, easylog, async_simp…
      C++
      309000Updated Nov 26, 2025Nov 26, 2025