Search results

Documented example for autoscaling a multinode deployment

Status: Open.

#1799 In vllm-project/aibrix;

· musoles opened on Nov 24, 2025

RFC: Add decode-first routing for short prompts to bypass remote prefill

Status: Open.

#1798 In vllm-project/aibrix;

· googs1025 opened on Nov 24, 2025

Requests are forwarded to the wrong Pod when using StormService for distributed inference

Status: Open.

#1796 In vllm-project/aibrix;

· zhixian82 opened on Nov 24, 2025

Volcano PodGroup annotation key is incorrect

Status: Open.

#1794 In vllm-project/aibrix;

· zhixian82 opened on Nov 24, 2025

Add Fine-Grained Server-Level Routing in ModelRouter for Multi-Server Pods

Status: Open.

#1793 In vllm-project/aibrix;

· paranoidRick opened on Nov 23, 2025

Ensure aibrix_kvcache Torch version stays compatible with latest vLLM/SGLang releases

Status: Open.

#1788 In vllm-project/aibrix;

· Jeffwan opened on Nov 22, 2025

Consider shortening hash template length to mitigate 63-char name limit issues

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1787 In vllm-project/aibrix;

· googs1025 opened on Nov 22, 2025

when use stormservice to deploy sglang pd case, "routing role" and "pd_disaggregation.go doPrefillRequest" which one make sense？？

Status: Open.

#1786 In vllm-project/aibrix;

· carolove opened on Nov 21, 2025

Add ut cases of PodGroup util and improve controller integration about PodGroup

Status: Open.

#1784 In vllm-project/aibrix;

· freedown19 opened on Nov 21, 2025

Request: Create unified sglang/vllm images to use both AIBrix KVCache and routing features

Status: Open.

#1780 In vllm-project/aibrix;

· dczhu opened on Nov 20, 2025

Bug: Build fails with "invalid array length -delta * delta" due to golang.org/x/tools version incompatibility

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1779 In vllm-project/aibrix;

· googs1025 opened on Nov 20, 2025

routing-strategy timeout

Status: Open.

#1774 In vllm-project/aibrix;

· xi1212 opened on Nov 20, 2025