v3.x

List view

[Bug] IndexTTS2 /v1/audio/speech returns 500 at WAV save: libtorchcodec cannot load in v2.12.0 Docker

bugSomething isn't workingSomething isn't working

gpu

stale

Status: Open.

#5201 In xorbitsai/inference;

· kvenLin opened on Jul 18, 2026

arm架构启动bge-reranker-large,只创建1个实例不能访问。需要创建2个独立实例，第1个实例才能访问(第二个不能访问)。

gpu

stale

Status: Open.

#5190 In xorbitsai/inference;

· 316719744 opened on Jul 17, 2026

First launch after a virtualenv (re)build always fails: model subprocess is spawned BEFORE venv packages are installed, caching host-version base libraries in sys.modules

bugSomething isn't workingSomething isn't working

stale

Status: Open.

#5189 In xorbitsai/inference;

· kejhz653-stack opened on Jul 17, 2026

feat: add one-line install script for Linux/macOS

feature

gpu

Status: Open (in progress).

xorbitsai/inferencenumber 5178

#5178 In xorbitsai/inference;

· OliverBryant opened on Jul 14, 2026

Unauthenticated arbitrary-path file read (partial) via /v1/models/llm/auto-register, plus unauthenticated arbitrary module import via flexible launcher

stale

Status: Open.

#5176 In xorbitsai/inference;

· geo-chen opened on Jul 13, 2026

[Docker CD] Failure on main

gpu

stale

Status: Open.

#5104 In xorbitsai/inference;

· github-actions opened on Jun 29, 2026

fix(api): support Claude Code Anthropic tool flows with Qwen chat templates

bugSomething isn't workingSomething isn't working

Status: Open (in progress).

xorbitsai/inferencenumber 5051

#5051 In xorbitsai/inference;

· ace-xc opened on Jun 18, 2026

Draft: parse tool_calls arguments

Status: Open (in progress).

xorbitsai/inferencenumber 4921

#4921 In xorbitsai/inference;

· la1ty opened on May 18, 2026

feat: batch text-only MLX VLM requests

feature

Status: Open (in progress).

xorbitsai/inferencenumber 4918

#4918 In xorbitsai/inference;

· qinxuye opened on May 16, 2026

fix: include user-defined LLM families in _resolve_architectures

bugSomething isn't workingSomething isn't working

Status: Open (in progress).

xorbitsai/inferencenumber 4860

#4860 In xorbitsai/inference;

· Ricardo-M-L opened on Apr 27, 2026

ENH: SDNQ Diffusers Quantizer

enhancementNew feature or requestNew feature or request

feature

Status: Open.

#4633 In xorbitsai/inference;

· iwr-redmond opened on Feb 27, 2026

ENH: update model "gpt-oss" JSON

enhancementNew feature or requestNew feature or request

Status: Open (in progress).

xorbitsai/inferencenumber 4501

#4501 In xorbitsai/inference;

· OliverBryant opened on Jan 16, 2026

BUG: MLX distributed error with vscode cline

bugSomething isn't workingSomething isn't working

Status: Open (in progress).

xorbitsai/inferencenumber 4379

#4379 In xorbitsai/inference;

· OliverBryant opened on Dec 17, 2025

BUG: worker dead with xoscar v0.8.0

bugSomething isn't workingSomething isn't working

Status: Open (in progress).

xorbitsai/inferencenumber 4363

#4363 In xorbitsai/inference;

· OliverBryant opened on Dec 15, 2025

FEAT: mistral-small-3.2-instruct model support

feature

Status: Open (in progress).

xorbitsai/inferencenumber 3820

#3820 In xorbitsai/inference;

· llyycchhee opened on Jul 21, 2025

FEAT: [UI] implement step-by-step user onboarding.

feature

Status: Open (in progress).

xorbitsai/inferencenumber 3530

#3530 In xorbitsai/inference;

· yiboyasss opened on May 27, 2025

FEAT: Kimi-VL-A3B

feature

Status: Draft (not ready).

xorbitsai/inferencenumber 3372

#3372 In xorbitsai/inference;

· Minamiyama opened on May 2, 2025

FEAT: jina-reranker-m0

feature

Status: Draft (not ready).

xorbitsai/inferencenumber 3209

#3209 In xorbitsai/inference;

· Minamiyama opened on Apr 9, 2025

FEAT: new model mPLUG-Owl3

feature

Status: Draft (not ready).

xorbitsai/inferencenumber 3199

#3199 In xorbitsai/inference;

· Minamiyama opened on Apr 7, 2025

FEAT: bge vl embedding series

feature

Status: Draft (not ready).

xorbitsai/inferencenumber 3092

#3092 In xorbitsai/inference;

· Minamiyama opened on Mar 19, 2025

UI: github in model card, and open in new

Status: Open (in progress).

xorbitsai/inferencenumber 2923

#2923 In xorbitsai/inference;

· Minamiyama opened on Feb 23, 2025

ENH: cosyvoice support pt file

enhancementNew feature or requestNew feature or request

Status: Open (in progress).

xorbitsai/inferencenumber 2431

#2431 In xorbitsai/inference;

· Minamiyama opened on Oct 12, 2024

REF: load model card json

refactor

Status: Open (in progress).

xorbitsai/inferencenumber 2246

#2246 In xorbitsai/inference;

· Minamiyama opened on Sep 7, 2024

BUG: Fix ChatTTS stream

bugSomething isn't workingSomething isn't working

Status: Draft (not ready).

xorbitsai/inferencenumber 2101

#2101 In xorbitsai/inference;

· codingl2k1 opened on Aug 16, 2024

FEAT: Initially support OpenVINO

feature

Status: Open (in progress).

xorbitsai/inferencenumber 1677

#1677 In xorbitsai/inference;

· qinxuye opened on Jun 20, 2024