Skip to content

@doublewordai doublewordai

All

    Repositories list

    72 repositories

    • control-layer-chart

      Public
      A Helm chart for the Doubleword control layer
      Go Template
      •
      Apache License 2.0
      •0•0•1•11•Updated Oct 13, 2026Oct 13, 2026

    • inference-lab-web

      Public
      Interactive web interface for the Inference Lab LLM simulator
      TypeScript
      •
      MIT License
      •0•0•1•15•Updated Oct 12, 2026Oct 12, 2026

    • silt

      Public
      Rust
      •
      MIT License
      •0•1•1•10•Updated Oct 12, 2026Oct 12, 2026

    • control-layer

      Public
      The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single auth…
      gatewayopenaillm
      gatewayopenaillm
      Rust
      •
      Apache License 2.0
      •16•95•5•94•Updated Oct 12, 2026Oct 12, 2026

    • inference-lab

      Public
      High-performance LLM inference simulator for analyzing serving systems
      Rust
      •
      MIT License
      •2•10•1•21•Updated Oct 12, 2026Oct 12, 2026

    • dynamo-upstream

      Public
      A Datacenter Scale Distributed Inference Serving Framework
      Rust
      •
      Other
      •1.7k•0•0•6•Updated Oct 12, 2026Oct 12, 2026

    • snapshot

      Public
      Snapshot gets GPU pods ready in seconds instead of minutes — by restoring a fully initialized GPU worker instead of starting one from scratch. Kubernetes-native…
      Go
      •
      Apache License 2.0
      •27•0•0•8•Updated Oct 12, 2026Oct 12, 2026

    • sglang-upstream

      Public
      SGLang is a high-performance serving framework for large language models and multimodal models.
      Python
      •
      Apache License 2.0
      •9.5k•0•4•12•Updated Oct 12, 2026Oct 12, 2026

    • outlet-postgres

      Public
      A plugin for the https://github.com/doublewordai/outlet middleware, for publishing requests & responses through an axum server to postgres
      Rust
      •
      MIT License
      •0•0•2•11•Updated Oct 11, 2026Oct 11, 2026

    • outlet

      Public
      A high-performance Axum middleware for capturing and correlating HTTP requests and responses with full streaming support.
      Rust
      •
      MIT License
      •0•2•2•11•Updated Oct 11, 2026Oct 11, 2026

    • autobatcher

      Public
      Drop-in AsyncOpenAI replacement that transparently batches requests
      Python
      •
      MIT License
      •4•24•2•10•Updated Oct 11, 2026Oct 11, 2026

    • parfold

      Public
      Parallel async primitives: fold, unfold, map, filter, and sorting
      Python
      •
      MIT License
      •0•0•1•6•Updated Oct 11, 2026Oct 11, 2026

    • doubleword-opencode-ocx

      Public
      Python
      •0•0•0•1•Updated Oct 10, 2026Oct 10, 2026

    • swarm

      Public
      Python
      •0•1•0•2•Updated Oct 10, 2026Oct 10, 2026

    • arbiter

      Public
      DeBERTa inference server for sequence classification
      Rust
      •0•0•2•10•Updated Oct 10, 2026Oct 10, 2026

    • qlm

      Public
      QLM - Query Language for Models
      Rust
      •
      MIT License
      •0•1•1•10•Updated Oct 9, 2026Oct 9, 2026

    • Mooncake

      Public
      Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
      C++
      •
      Apache License 2.0
      •1.3k•0•0•1•Updated Oct 9, 2026Oct 9, 2026

    • blog

      Public
      TypeScript
      •0•0•0•10•Updated Oct 7, 2026Oct 7, 2026

    • documentation

      Public
      Developer documentation for DoubleWord products
      TypeScript
      •0•1•0•5•Updated Oct 7, 2026Oct 7, 2026

    • frontend-crates

      Public
      Rust
      •
      Apache License 2.0
      •54•0•0•13•Updated Oct 7, 2026Oct 7, 2026

    • docs

      Public
      Documentation for Doubleword AI Products.
      documentationdoubleword
      documentationdoubleword
      CSS
      •1•0•1•27•Updated Oct 6, 2026Oct 6, 2026

    • gigatoken

      Public
      Language model tokenization at GB/s
      Rust
      •
      MIT License
      •218•0•0•3•Updated Oct 6, 2026Oct 6, 2026

    • doubleword-arize

      Public
      Python
      •0•1•0•3•Updated Oct 5, 2026Oct 5, 2026

    • modelexpress

      Public
      Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and improve overall performa…
      Python
      •
      Apache License 2.0
      •99•0•0•2•Updated Oct 5, 2026Oct 5, 2026

    • doubleword-skill

      Public
      Claude Code skill for working with the Doubleword Batch API
      MIT License
      •1•5•0•0•Updated Oct 1, 2026Oct 1, 2026

    • nixl

      Public
      NVIDIA Inference Xfer Library (NIXL)
      C++
      •
      Other
      •480•0•0•2•Updated Sep 29, 2026Sep 29, 2026

    • underway

      Public
      ⏳ Durable step functions via Postgres.
      Rust
      •
      Apache License 2.0
      •15•0•0•0•Updated Sep 29, 2026Sep 29, 2026

    • dw

      Public
      Rust
      •
      MIT License
      •0•4•0•1•Updated Sep 24, 2026Sep 24, 2026

    • uccl

      Public
      UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
      C++
      •
      Apache License 2.0
      •179•0•0•14•Updated Sep 22, 2026Sep 22, 2026

    • DeepEP

      Public
      DeepEP: an efficient expert-parallel communication library
      Cuda
      •
      MIT License
      •1.5k•0•0•0•Updated Sep 22, 2026Sep 22, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.