Pinned Loading

1. conductor conductor Public

   Forked from conductor-oss/conductor

   Conductor is a microservices orchestration engine.

   Java

2. vllm-project/production-stack vllm-project/production-stack Public

   vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

   Python 2.5k 464

3. kserve kserve Public

   Forked from kserve/kserve

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Shell

4. LMCache LMCache Public

   Forked from LMCache/LMCache

   LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

   Python