Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 47.9k 7.6k

2. LMCache/LMCache LMCache/LMCache Public

   Redis for LLMs

   Python 1.1k 167

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

4. rocksdb_cris rocksdb_cris Public

   Forked from umn-cris/rocksdb

   A library that provides an embeddable, persistent key-value store for fast storage.

   C++

5. GRE_buck_index GRE_buck_index Public

   C++ 1

6. gdymind/Buck-Learned-Index gdymind/Buck-Learned-Index Public

   C++ 4