Pinned Loading

1. langX101 langX101 Public

   langX101

   Jupyter Notebook 16 11

2. llama-stack llama-stack Public

   Forked from llamastack/llama-stack

   Composable building blocks to build Llama Apps

   Python

3. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

4. llm-d-inference-scheduler llm-d-inference-scheduler Public

   Forked from llm-d/llm-d-inference-scheduler

   Inference scheduler for llm-d

   Go

5. llm-d-kv-cache llm-d-kv-cache Public

   Forked from llm-d/llm-d-kv-cache

   Distributed KV cache scheduling & offloading libraries

   Go

6. llm-d-workload-variant-autoscaler llm-d-workload-variant-autoscaler Public

   Forked from llm-d/llm-d-workload-variant-autoscaler

   Variant optimization autoscaler for distributed inference workloads

   Go