-
Notifications
You must be signed in to change notification settings - Fork 484
Pull requests: vllm-project/production-stack
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[Bugfix][Router] Use supplied timestamp for avg_latency and drop completed request maps
#1080
opened Sep 7, 2026 by
nisaral
Loading…
[Operator] Add separate resource requests and limits
#1079
opened Sep 3, 2026 by
banlor
Contributor
Loading…
[Router][Bugfix] Cache KV-aware tokenizers per model
#1077
opened Sep 3, 2026 by
dsxyy
Contributor
Loading…
3 tasks done
[Router][Bugfix] Log a warning when an engine scrape matches zero known metric names
#1076
opened Sep 2, 2026 by
pujitha24
Loading…
3 tasks done
[Router][Bugfix] Decouple the engine-stats read timeout from the scrape interval
#1075
opened Sep 2, 2026 by
sethforprivacy
Loading…
3 tasks done
[Bugfix][Router] Fix leaked in-flight counters in RequestStatsMonitor
#1072
opened Sep 2, 2026 by
lfsun02
Contributor
Loading…
3 tasks done
[Feat] Support command and args on servingEngineSpec.modelSpec
#1071
opened Sep 1, 2026 by
dundysm
Loading…
2 of 3 tasks
[Bugfix][Router] Default transcription language to None (auto-detect)
#1070
opened Sep 1, 2026 by
WaelRabah
Contributor
Loading…
[Bugfix][Router] Run KvawareRouter /tokenize fallback in executor to avoid blocking event loop
#1069
opened Aug 29, 2026 by
Asthenia0412
Loading…
[Bugfix][Helm] Only pass --k8s-service-discovery-type when explicitly set to non-default
#1068
opened Aug 29, 2026 by
Asthenia0412
Loading…
fix: Improve JSON parsing robustness under high concurrency
#1067
opened Aug 29, 2026 by
Asthenia0412
Loading…
fix: Use per-model tokenizer in KvawareRouter for multi-model setups
#1066
opened Aug 29, 2026 by
Asthenia0412
Loading…
fix: Replace exec liveness probe with tcpSocket for LMCache cache server
#1065
opened Aug 29, 2026 by
Asthenia0412
Loading…
fix: Use broad except clause for k8s config loading to avoid TypeError
#1064
opened Aug 29, 2026 by
Asthenia0412
Loading…
fix: Add OpenAPI request body schema to all POST routes for Swagger UI
#1063
opened Aug 29, 2026 by
Asthenia0412
Loading…
3 tasks
[Doc] Tutorial 17: troubleshooting the silent-miss preconditions of kvaware routing
#1062
opened Aug 29, 2026 by
tyler2cr
Loading…
[Router][Bugfix] Defensive fallbacks in kvaware routing: 503 on no endpoints, session/QPS on unmapped instance
#1061
opened Aug 29, 2026 by
tyler2cr
Loading…
[CI/Build][Router] Enable lmcache 0.5.4 for the kvaware router stack
#1060
opened Aug 28, 2026 by
tyler2cr
Loading…
[Bugfix] Use TCP liveness probe for LMCache server
#1058
opened Aug 27, 2026 by
EltonChang1
•
Draft
3 tasks done
[Bugfix][Router] Update average decoding duration stats
#1054
opened Aug 25, 2026 by
dsxyy
Contributor
Loading…
[Doc][Router] Clarify RequestStatsMonitor TTFT timing
#1053
opened Aug 25, 2026 by
dsxyy
Contributor
Loading…
[Doc] Fix KvawareRouter QPS fallback description
#1051
opened Aug 25, 2026 by
dsxyy
Contributor
Loading…
[Helm] Allow setting extra env vars on the LMCache cache server container
#1048
opened Aug 24, 2026 by
pujitha24
Loading…
3 tasks done
[Router][Bugfix] KV-aware routing: tokenize chat-completions bodies through the chat template
#1045
opened Aug 21, 2026 by
tyler2cr
Loading…
[Feat] Support additional sidecar containers and service labels per model
#1044
opened Aug 21, 2026 by
SSvilen
Loading…
3 tasks done
Previous Next
ProTip!
Filter pull requests by the default branch with base:main.