Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 2.5k 332

2. llm-d-incubation/llm-d-fast-model-actuation llm-d-incubation/llm-d-fast-model-actuation Public

   Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping

   Go 9 11