Pinned Loading

1. large_language_monkeys large_language_monkeys Public

   Python 92 21

2. Archon Archon Public

   Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.

   Python 173 18

3. CATS CATS Public

   Python 24 5

4. hydragen hydragen Public

   Hydragen: High-Throughput LLM Inference with Shared Prefixes

   Python 36 3