Skip to content

Commit e822bfe

Browse files
Luminal Flash lane: raise SESSION_CEILING 750 -> 830 (+80)
Free DeepSeek V4 Flash sessions on the Luminal lane. 750 was set just under the floor of Luminal's observed 748-866 refusal band; 830 sits inside it, so a pegged cap should be read as touching the band rather than as headroom. Updates the maintained arithmetic (largest slow-start step 238 -> 318) and adds a dated decision-log entry. Rollback is one line: 830 -> 750 and deploy. It remains a code constant, not the stale FREEBUFF_LUMINAL_MAX_SESSIONS env var, per the file's own warning. The 10 unit tests in luminal-admission.test.ts pass. 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com>
1 parent b0a73b6 commit e822bfe

1 file changed

Lines changed: 30 additions & 6 deletions

File tree

web/src/server/free-session/luminal-admission.ts

Lines changed: 30 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -166,7 +166,9 @@ export const CAP_FLOOR = 2
166166
* on 2026-08-21, when hit rate fell 98.5% to 4.5% and time-to-first-token went
167167
* to 134s while the controller sat at its cap having never been refused once.
168168
*
169-
* 750 IS OURS, AND IT IS DELIBERATELY BELOW WHAT LUMINAL APPROVED. They
169+
* 750 IS OURS, AND IT IS DELIBERATELY BELOW WHAT LUMINAL APPROVED — as of
170+
* 2026-09-04. (2026-09-09: raised to 830, which sits inside the refusal band
171+
* instead of under it; see `## 830 as of 2026-09-09` below.) They
170172
* sanctioned 1700 on 2026-09-02. We ran there, found it is not a number they
171173
* can actually serve, and came back down on 2026-09-04. This is the first value
172174
* in this file's history set LOWER than the sanctioned one.
@@ -425,13 +427,14 @@ export const CAP_FLOOR = 2
425427
* is both the roof discovery may not pass AND the level slow-start doubles
426428
* straight to (see the two-gear section at the top), because a lane with no
427429
* refusal on record has nothing else to treat as safe. From the floor that is
428-
* nine doublings to 750, a little over two minutes at GROW_INTERVAL_MS — also
430+
* nine doublings to 830, a little over two minutes at GROW_INTERVAL_MS — also
429431
* how fast the lane refills after the nightly off-peak closure wipes the
430432
* controller's state.
431433
*
432-
* The largest single step is 238 sessions: doubling lands on 512 and the next
433-
* tick clamps 1024 to this ceiling, so the fast gear crosses 512 -> 750 in one
434-
* 15s interval with no additive probe in it. Three reviews — #2399, #2403,
434+
* The largest single step is 318 sessions: doubling lands on 512 and the next
435+
* tick clamps 1024 to this ceiling, so the fast gear crosses 512 -> 830 in one
436+
* 15s interval with no additive probe in it. (At the 750 ceiling the same step
437+
* was 238, which is the number the sections below still quote.) Three reviews — #2399, #2403,
435438
* #2583 — have asked for a `safeLevel` clamp so the range above a known-good
436439
* level creeps instead, and it is still not applied. Lowering the ceiling to
437440
* 750 shrank that jump from 676 to 238 as a side effect, which is the main
@@ -466,6 +469,27 @@ export const CAP_FLOOR = 2
466469
* the number here, not there. Getting a constant wrong costs a deploy; getting
467470
* that wrong costs the cache collapse this prevents.
468471
*
472+
* ## 830 as of 2026-09-09
473+
*
474+
* Raised +80 (750 -> 830) on request. Unlike every raise above, this one has NO
475+
* clean reading behind it: 750 was set deliberately just under the floor of the
476+
* 748-866 refusal band, and 830 sits INSIDE that band. In our units 830 sessions
477+
* is about 423 concurrent requests at the measured 1.96:1, against a band floor
478+
* of roughly 383 — so if Luminal's capacity has not moved, the honest expectation
479+
* is that the controller gets refused at the top of the climb, cuts to 90%, and
480+
* oscillates under 830 rather than pegging there. That is the regime the 2026-09-03
481+
* collapse demonstrated the cost of: admission runs once per session, every 429 is
482+
* a PERMANENT eviction that strands a warm prefix and degrades BOTH caches, and the
483+
* closer the cap sits to the refusal floor the more sessions pay that price.
484+
*
485+
* What bounds the risk: occupancy peaked at 768 against caps of 866, so the expected
486+
* regime is a cap that sits at or just under 830 with the working set where it was.
487+
* Watch the cache gap and time-to-first-token as closely as the cap itself, and read
488+
* a pegged cap at 830 as a warning, not as headroom — at 750 a pegged cap meant the
489+
* roof was too low; at 830 it means we are touching the band.
490+
*
491+
* Rollback is one line: put 750 back and deploy.
492+
*
469493
* ## 750 as of 2026-09-04, and the duty cycle that made the raises possible
470494
*
471495
* Raised because WE were the refusal, not Luminal. Measured over 45 minutes at
@@ -535,7 +559,7 @@ export const CAP_FLOOR = 2
535559
* delete this constant and the `ceiling` argument to ADMIT_SCRIPT and let
536560
* discovery run unbounded again, which is what it was designed to do.
537561
*/
538-
export const SESSION_CEILING = 750
562+
export const SESSION_CEILING = 830
539563

540564
/**
541565
* How long the cap sits still between increases — in BOTH gears, as of

0 commit comments

Comments
 (0)