-
Notifications
You must be signed in to change notification settings - Fork 292
OpenJul 26, 2026
Due by August 7, 2026
•Last updated 78% complete
List view
0 of 27 selected 0 issues of 27 selected
- Status: Open.#1692 In llm-d/llm-d-router;
Encoder cache improvements
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1144 In llm-d/llm-d-router;Evaluate predicted latency with precise tokens accounting
triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.Status: Open.#1292 In llm-d/llm-d-router;[Flow Control] Eviction of in-flight dispatched requests
triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.Status: Open.#1119 In llm-d/llm-d-router;Evaluate predicted latency based scheduling for multi-modal workloads
triage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.Status: Open.#1293 In llm-d/llm-d-router;Split the "monolithic"
precise-prefix-cache-scorertriage/acceptedIndicates an issue or PR is ready to be actively worked on.Indicates an issue or PR is ready to be actively worked on.Status: Open.#1299 In llm-d/llm-d-router;feat(observability): add mm.modality, mm.hash_count, mm.hit to EPP scheduler spans
kind/featureCategorizes issue or PR as related to a new feature.Categorizes issue or PR as related to a new feature.size/XLDenotes a PR that changes 500-999 lines, ignoring generated files.Denotes a PR that changes 500-999 lines, ignoring generated files.Status: Open (in progress).Performance optimizations for vllm render api in precise prefix-cache aware routing for multimidal workloads
[mm]MultimodalMultimodalneeds-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1552 In llm-d/llm-d-router;Add multimodal support for predicted latency based scheduling
[mm]MultimodalMultimodalneeds-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1748 In llm-d/llm-d-router;Evaluate the llmd multimodal support for sgalng model server
[mm]MultimodalMultimodalneeds-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1749 In llm-d/llm-d-router;Umbrella Issue: Support deferred decoding in EPP with E-disaggregation
[mm]MultimodalMultimodalneeds-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1752 In llm-d/llm-d-router;Investigate how llm-d-router can support diffusion model
[mm]MultimodalMultimodalneeds-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1753 In llm-d/llm-d-router;- Status: Open.#1862 In llm-d/llm-d-router;
[Agentic] Optimized router config for agentic traces
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1867 In llm-d/llm-d-router;[FEAT] Introduce Plugin Stability Lifecycle (Alpha, Beta, Stable) and Dependency Validation
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#1912 In llm-d/llm-d-router;- Status: Open.#1574 In llm-d/llm-d-router;
[Agentic] Experimental integration of Session Control Protocol
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2003 In llm-d/llm-d-router;- Status: Open.#2006 In llm-d/llm-d-router;
Support high availability and near zero degraded routing via hot standby
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2055 In llm-d/llm-d-router;- Status: Open.#2019 In llm-d/llm-d-router;
[Flow Control] [Graduation Blocker] Stale-metrics saturation silently halts all dispatch; pool_saturation help text contradicts its semantics
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2100 In llm-d/llm-d-router;[Flow Control] [Graduation Blocker] Per-band and global queue utilization ratio gauges
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2102 In llm-d/llm-d-router;[Flow Control] Queue-wait TTL eviction should return 429, not 503, when the pool has endpoints
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2046 In llm-d/llm-d-router;[Flow Control] [Graduation Blocker] Pre-admission TTL/cancel returns 500; registry lookup failure mislabeled as saturation (429)
kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2097 In llm-d/llm-d-router;[Flow Control] [Graduation Blocker] Enable the flowControl feature gate by default
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2104 In llm-d/llm-d-router;