-
Notifications
You must be signed in to change notification settings - Fork 26
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
[Metrics] Deadline Proximity histogram (time-to-deadline of queued items)
enhancementNew feature or requestNew feature or requestStatus: Open.[Metrics] Token Throughput counter (input + output tokens processed)
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: Consider active requests and inflight tokens for saturation signal
enhancementNew feature or requestNew feature or requestStatus: Open.- Status: Open.
[Feature]: Throttle Worker Pool Workers by Gate Budget
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: unify config across backends
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: Response body-transform extension point (symmetric to #255) for post-dispatch payload rewriting
enhancementNew feature or requestNew feature or requestStatus: Open.- Status: Open.
[Feature]: Model Override
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: DispatchGates should be assigned to inference targets
enhancementNew feature or requestNew feature or requestStatus: Open.Add PubSub queue impl to e2e tests
enhancementNew feature or requestNew feature or requestStatus: Open.[Feature]: Support per-queue dispatch gates for ephemeral Redis (redis-pubsub)
enhancementNew feature or requestNew feature or requestStatus: Open.#76 In llm-d/llm-d-async;