Popular repositories Loading

1. MAD MAD Public

   Forked from ROCm/MAD

   Shell

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

3. rccl rccl Public

   Forked from ROCm/rccl

   ROCm Communication Collectives Library (RCCL)

   C++

4. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. llm-d-router llm-d-router Public

   Forked from llm-d/llm-d-router

   llm-d Router: The intelligent entry point for inference requests

   Go