Pinned Loading

1. SqueezeBits/owlite SqueezeBits/owlite Public

   OwLite is a low-code AI model compression toolkit for AI models.

   Python 53 4

2. SqueezeBits/Torch-TRTLLM SqueezeBits/Torch-TRTLLM Public

   Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.

   Python 55 3

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 76.4k 15.5k

4. HabanaAI/vllm-hpu-extension HabanaAI/vllm-hpu-extension Public

   Python 15 48

5. stas00/ml-engineering stas00/ml-engineering Public

   Machine Learning Engineering Open Book

   Python 17.7k 1.1k

6. RBLN-SW/vllm-rbln RBLN-SW/vllm-rbln Public

   vLLM plugin for RBLN NPU

   Python 46 9