Popular repositories Loading

1. LMCache LMCache Public

   Forked from LMCache/LMCache

   Redis for LLMs

   Python 1

2. ovs ovs Public

   C

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. nixl nixl Public

   Forked from ai-dynamo/nixl

   NVIDIA Inference Xfer Library (NIXL)

   C++

5. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

6. uccl uccl Public

   Forked from uccl-project/uccl

   UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

   C++