Skip to content

@SqueezeBits SqueezeBits Inc.

Change the repository type filter

All

    Repositories list

    28 repositories

    • modular

      Public
      The Modular Platform (includes MAX & Mojo)
      Mojo
      •
      Other
      •2.8k•0•0•8•Updated Mar 19, 2026Mar 19, 2026

    • vllm-rbln

      Public
      vLLM plugin for RBLN NPU
      Python
      •
      Apache License 2.0
      •8•0•0•0•Updated Feb 26, 2026Feb 26, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •15k•0•0•0•Updated Feb 10, 2026Feb 10, 2026

    • guidellm-rbln-vllm

      Public
      Python
      •0•0•0•0•Updated Jan 22, 2026Jan 22, 2026

    • Gaudi-Hands-on-Workshop

      Public
      Jupyter Notebook
      •2•6•0•0•Updated Jan 18, 2026Jan 18, 2026

    • yetter-client

      Public
      Yetter Python Client
      Python
      •0•0•0•0•Updated Dec 24, 2025Dec 24, 2025

    • Intel-Gaudi-Hands-on-Workshop

      Public
      Intel-Gaudi-Hands-on-Workshop
      0•0•0•0•Updated Dec 15, 2025Dec 15, 2025

    • GraLoRA

      Public
      Jupyter Notebook
      •2•32•0•0•Updated Nov 18, 2025Nov 18, 2025

    • owlite

      Public
      OwLite is a low-code AI model compression toolkit for AI models.
      Python
      •
      GNU Affero General Public License v3.0
      •4•53•0•0•Updated Nov 14, 2025Nov 14, 2025

    • owlite-examples

      Public
      OwLite Examples repository offers illustrative example codes to help users seamlessly compress PyTorch deep learning models and transform them into TensorRT eng…
      Python
      •1•9•1•1•Updated Nov 14, 2025Nov 14, 2025

    • llm-compressor

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      Python
      •
      Apache License 2.0
      •445•0•0•0•Updated Nov 12, 2025Nov 12, 2025

    • transformers

      Public
      🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference an…
      Python
      •
      Apache License 2.0
      •33k•0•0•0•Updated Nov 4, 2025Nov 4, 2025

    • vllm-fork

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •15k•0•0•0•Updated Nov 4, 2025Nov 4, 2025

    • ml-engineering

      Public
      Machine Learning Engineering Open Book
      Python
      •
      Creative Commons Attribution Share Alike 4.0 International
      •1.1k•1•0•0•Updated Sep 1, 2025Sep 1, 2025

    • sglang-guided-decoding

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      •
      Apache License 2.0
      •4.9k•0•0•0•Updated Aug 28, 2025Aug 28, 2025

    • Torch-TRTLLM

      Public
      Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.
      Python
      •
      Apache License 2.0
      •3•55•0•0•Updated Jul 16, 2025Jul 16, 2025

    • vllm-guided-decoding

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •15k•0•0•0•Updated Jul 14, 2025Jul 14, 2025

    • LMCache

      Public
      Redis for LLMs
      Python
      •
      Apache License 2.0
      •1k•0•0•0•Updated Jul 10, 2025Jul 10, 2025

    • swifty-llm

      Public
      0•0•0•0•Updated Jul 9, 2025Jul 9, 2025

    • TensorRT-LLM

      Public
      TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optim…
      C++
      •
      Apache License 2.0
      •2.2k•0•0•1•Updated Jun 26, 2025Jun 26, 2025

    • fal-js

      Public
      The JavaScript client and utilities to fal-serverless with built-in TypeScript definitions
      TypeScript
      •
      MIT License
      •40•0•0•0•Updated May 30, 2025May 30, 2025

    • gradio

      Public
      Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
      Python
      •
      Apache License 2.0
      •3.3k•0•0•0•Updated Jan 13, 2025Jan 13, 2025

    • vllm-hpu-extension

      Public
      Python
      •
      Apache License 2.0
      •49•0•0•0•Updated Nov 22, 2024Nov 22, 2024

    • neural-compressor

      Public
      Intel Neural Compressor
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Oct 22, 2024Oct 22, 2024

    • nvidia-dind

      Public
      Isolated DinD (Docker in Docker) container for developing and deploying Docker containers using NVIDIA GPUs and the NVIDIA container toolkit. Useful for deployi…
      Dockerfile
      •
      Mozilla Public License 2.0
      •19•0•0•0•Updated Aug 27, 2024Aug 27, 2024

    • mlperf_inference_results_v4.0

      Public
      C++
      •
      Apache License 2.0
      •1•0•0•1•Updated Jul 23, 2024Jul 23, 2024

    • .github

      Public
      0•0•0•0•Updated Jul 22, 2024Jul 22, 2024

    • QUICK

      Public
      QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
      Python
      •
      MIT License
      •5•120•6•0•Updated Mar 6, 2024Mar 6, 2024