Pinned Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

2. aiter aiter Public

   Forked from ROCm/aiter

   AI Tensor Engine for ROCm

   Python

3. bert bert Public

   Forked from google-research/bert

   TensorFlow code and pre-trained models for BERT

   Python

4. FasterTransformer FasterTransformer Public

   Forked from THUDM/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++

5. sglang sglang Public

   Forked from zejunchen-zejun/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python