Pinned Loading

1. wsl2-bootstraper wsl2-bootstraper Public

   A PowerShell script to provision Ubuntu‑24.04 on WSL2 with Python, Docker, Zsh, and more — idempotent & user‑configurable.

   PowerShell

2. Kernel-ML/mlprobe Kernel-ML/mlprobe Public

   MLProbe is a Python package for validating ML models before deployment. It provides automated checks for model performance, data drift, failure modes, and CI/CD integration.

   Python 1

3. Kernel-ML/scaleinfer Kernel-ML/scaleinfer Public

   Modular ML inference pipeline for real-time recommendation systems.

   Python 2

4. BentoML BentoML Public

   Forked from bentoml/BentoML

   The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

   Python

5. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 91.2k 21.9k

6. vllm-project/semantic-router vllm-project/semantic-router Public

   A programmable Mixture-of-Models router for heterogeneous LLM inference

   Go 5.7k 921