Pinned Loading

1. ModelTC/lightllm ModelTC/lightllm Public

   LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

   Python 3.2k 254

2. ModelTC/MQBench ModelTC/MQBench Public

   Model Quantization Benchmark

   Python 803 142

3. ModelTC/llmc ModelTC/llmc Public

   [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

   Python 472 53