Skip to content

Commit 92060d8

Browse files
docs: add release-note fragment for PR #2123 (#2159)
Signed-off-by: llm-d-router-release-notes[bot] <287676111+llm-d-router-release-notes[bot]@users.noreply.github.com> Co-authored-by: llm-d-router-release-notes[bot] <287676111+llm-d-router-release-notes[bot]@users.noreply.github.com>
1 parent 9ebdd7e commit 92060d8

1 file changed

Lines changed: 7 additions & 0 deletions

File tree

release-notes.d/unreleased/2123.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
---
2+
pr: 2123
3+
url: https://github.com/llm-d/llm-d-router/pull/2123
4+
author: LukeAVanDrie
5+
date: 2026-07-23
6+
---
7+
Flow control queueing is now bounded by default: `defaultRequestTTL` defaults to 60s and per-band `maxRequests` defaults to 5000 when unset. For existing flow control users this is a behavior change: an explicit `defaultRequestTTL: "0s"` disables the TTL (requests then wait until client disconnect), and a band `maxRequests`/`maxBytes` of 0 is treated as unset and receives the default. To approximate the legacy fast-fail behavior for sheddable traffic, configure a small `defaultNegativePriorityBand.maxRequests`. Scale-to-zero deployments should raise `defaultRequestTTL` above the expected cold-start time.

0 commit comments

Comments
 (0)