Skip to content

@EmbeddedLLM EmbeddedLLM

Change the repository type filter

All

    Repositories list

    74 repositories

    • skypilot

      Public
      SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
      Python
      •
      Apache License 2.0
      •1.1k•2•0•0•Updated May 25, 2026May 25, 2026

    • vllm

      Public
      vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
      inferencepytorchtransformer
      inferencepytorchtransformergptamdgpurocmmodel-servingllmllm-inference
      Python
      •
      Apache License 2.0
      •17k•95•1•8•Updated May 25, 2026May 25, 2026

    • litellm

      Public
      Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Re…
      Python
      •
      Other
      •8.3k•0•0•1•Updated May 25, 2026May 25, 2026

    • JamAIBase

      Public
      The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work tog…
      pythonworkflowai
      pythonworkflowaiserverlesschatbotspreadsheetsvelteorchestrationbaasagents
      Python
      •
      Apache License 2.0
      •41•1.1k•1•1•Updated May 23, 2026May 23, 2026

    • agentic-api

      Public
      Stateful API logic for agentic applications using vLLM
      Makefile
      •
      Apache License 2.0
      •10•0•0•0•Updated May 22, 2026May 22, 2026

    • aiter

      Public
      AI Tensor Engine for ROCm
      Python
      •
      MIT License
      •324•0•0•3•Updated May 20, 2026May 20, 2026

    • vllm-omni

      Public
      A high-throughput and memory efficient inference and serving engine for Omni-modality models
      Python
      •
      Apache License 2.0
      •984•0•0•0•Updated May 10, 2026May 10, 2026

    • LMCache

      Public
      ROCm support of Ultra-Fast and Cheaper Long-Context LLM Inference
      Python
      •
      Apache License 2.0
      •1.2k•0•0•0•Updated May 7, 2026May 7, 2026

    • tilelang-to-flydsl-skills

      Public
      Python
      •0•1•0•0•Updated May 6, 2026May 6, 2026

    • northwind-demo

      Public
      Agentic demo for the northwind dataset. to levels of capabilities increasing with number of tools provided.
      Python
      •0•0•0•0•Updated Apr 28, 2026Apr 28, 2026

    • apidayworkshop2026

      Public
      Python
      •
      Apache License 2.0
      •3•7•0•0•Updated Apr 25, 2026Apr 25, 2026

    • vllm-responses

      Public
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Apr 19, 2026Apr 19, 2026

    • pytorch3d

      Public
      PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
      Python
      •
      Other
      •1.5k•0•0•0•Updated Apr 17, 2026Apr 17, 2026

    • vllm-rocm-wheel

      Public
      Python
      •
      Apache License 2.0
      •0•0•0•4•Updated Apr 13, 2026Apr 13, 2026

    • ATOM

      Public
      AiTer Optimized Model
      Python
      •
      MIT License
      •61•0•0•1•Updated Apr 10, 2026Apr 10, 2026

    • TurboProtein

      Public
      0•0•0•0•Updated Apr 5, 2026Apr 5, 2026

    • FlyDSL

      Public
      FlyDSL is the Python front‑end of the project: Flexible LaYout DSL.
      Python
      •
      Other
      •54•0•0•0•Updated Apr 4, 2026Apr 4, 2026

    • agentic-stack

      Public
      Stateful API logic for agentic applications using vLLM
      Makefile
      •
      Apache License 2.0
      •10•0•0•0•Updated Mar 24, 2026Mar 24, 2026

    • nanobot

      Public
      "🐈 nanobot: The Ultra-Lightweight OpenClaw"
      Python
      •
      MIT License
      •7.6k•0•0•0•Updated Mar 14, 2026Mar 14, 2026

    • vllmtests

      Public
      This is a repository containing the tools for testing vLLM correctness and perf regression
      Python
      •
      Apache License 2.0
      •2•2•0•0•Updated Jan 15, 2026Jan 15, 2026

    • vllm-rocmfork

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •17k•1•0•0•Updated Jan 9, 2026Jan 9, 2026

    • jamaibase-ts-docs

      Public
      Typescript Documentation of JamAISDK
      HTML
      •0•0•0•0•Updated Jan 8, 2026Jan 8, 2026

    • lmms-eval

      Public
      One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
      Python
      •
      Other
      •592•0•0•0•Updated Jan 6, 2026Jan 6, 2026

    • fastsafetensors-rocm

      Public
      High-performance safetensors model loader
      Python
      •
      Apache License 2.0
      •28•0•0•2•Updated Dec 29, 2025Dec 29, 2025

    • vllm-wheel

      Public
      Python
      •
      Apache License 2.0
      •0•0•0•5•Updated Dec 8, 2025Dec 8, 2025

    • inference-experiment

      Public
      Collect the scripts and results of all reasoning experiments.
      Python
      •
      Apache License 2.0
      •1•0•0•0•Updated Dec 7, 2025Dec 7, 2025

    • recipes

      Public
      Common recipes to run vLLM
      Jupyter Notebook
      •
      Apache License 2.0
      •279•0•0•0•Updated Nov 25, 2025Nov 25, 2025

    • vllm-rocm

      Public
      Python
      •
      Apache License 2.0
      •0•2•0•0•Updated Nov 21, 2025Nov 21, 2025

    • vllm-project.github.io

      Public
      HTML
      •95•0•0•0•Updated Oct 3, 2025Oct 3, 2025

    • mistral-evals

      Public
      Python
      •14•0•0•0•Updated Sep 25, 2025Sep 25, 2025
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.