Pinned Loading

1. llm-d/llm-d-router llm-d/llm-d-router Public

   llm-d Router: The intelligent entry point for inference requests

   Go 205 221

2. moreh-dev/mif moreh-dev/mif Public

   MIF: MoAI Inference Framework

   MDX

3. kubernetes-sigs/gateway-api-inference-extension kubernetes-sigs/gateway-api-inference-extension Public

   Gateway API Inference Extension

   Go 678 294

4. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3.3k 508