Add more testing for chunked prefill#27506

Merged

fzyzcjy merged 627 commits into

mainfrom

tom/scripted_runtime_and_chunked_testing

Jun 9, 2026

This pull request is big! We're only showing the most recent 250 commits

Commits on May 31, 2026

Commits on Jun 1, 2026

Commits on Jun 2, 2026

Commits on Jun 5, 2026

Add kv_canary PP self-test fixture and SWA divergence coverage
fzyzcjy
committed
Add scripted-runtime harness core and wire scheduler/IPC hooks
fzyzcjy
committed
Add scripted-runtime KV-pool and lock-ref exhauster primitives
fzyzcjy
committed
Add scripted-runtime unit, core integration, and chunked-prefill tests
fzyzcjy
committed
Remove scripted disagg tests and revert the fake-prefill SRT relaxation
fzyzcjy
committed
Rename abort-mid-chunk radix test to match what it actually asserts
fzyzcjy
committed
Add PD x PP x chunked-prefill end-to-end test
fzyzcjy
committed
Add PD x PP x chunked e2e test alongside the chunked_prefill e2e suite
fzyzcjy
committed
Merge branch 'main-upstream' into tom/scripted_runtime_and_chunked_testing
fzyzcjy
committed
Merge sgl-project PR #26991 (scripted_runtime_extracted_chain) into tom/scripted_runtime_and_chunked_testing
fzyzcjy
committed
Apply black formatting to the merged core_1gpu finished-case assertion
fzyzcjy
committed
Fix scripted-test observation bugs: probe-all finish waits, None-safe release asserts, live captures
fzyzcjy
committed
Correct decode-forward-count law for the overlap scheduler
fzyzcjy
committed
Point LoRA and EAGLE scripted tests at models that exist and valid pool configs
fzyzcjy
committed
Drop remaining single-server disagg scripted tests; fix retract-abort expectation
fzyzcjy
committed
Make KV-pressure tests use retractable peers and valid configs
fzyzcjy
committed
Apply black formatting to scripted test fixes
fzyzcjy
committed
Restore DETERMINISTIC_ALIGN_SIZE swallowed by the TinyChunk class deletion
fzyzcjy
committed
Fix remaining manual scripted-test failures from the H200 rerun (round 2)
fzyzcjy
committed
Round 3: honest pressure pattern, pause-leak fix, co-batch premise fixes
fzyzcjy
committed
Apply black formatting to round-3 fixes
fzyzcjy
committed
Freeze chunks_done only after release in the abort-mid-chunk radix test
fzyzcjy
committed
Latch the chunked+decode coexistence window; add rotation chunk diagnostics
fzyzcjy
committed
De-alias per-script prompt tokens; engine-native small-KV-pool pressure classes
fzyzcjy
committed
Per-adapter pair assertion for LoRA rotation; move chunked+decode coexistence to mixed-chunk
fzyzcjy
committed
Keep a positive page floor under raw KV exhaustion; drain warm lock_refs
fzyzcjy
committed
Remove stale twin asserts after the pair reformulation; accept mixed-batch bucket as coexistence witness
fzyzcjy
committed
Replace the last raw-exhaustion pressure with engine-native ballast pairs
fzyzcjy
committed
Adaptively top up ballast pressure until the 16-token admission gate closes
fzyzcjy
committed
Make kv-recovery ballast prompts decisively close the admission gate
fzyzcjy
committed
Rebuild kv-recovery pressure on the proven ballast+chunked regime
fzyzcjy
committed
Fix e2e chunked suite: real kv-canary CLI flags and base-class collection
fzyzcjy
committed
E2E canary pairing/opt-outs and a gsm8k-capable LoRA setup
fzyzcjy
committed
Replace the stale Llama-1-era second LoRA adapter in the e2e pair
fzyzcjy
committed
Calibrate Llama-3.2-1B e2e thresholds, opt spec out of canary, drop the unrunnable hisparse e2e
fzyzcjy
committed
Switch the spec e2e to the proven EAGLE3 stack
fzyzcjy
committed
Merge the coexistence test into the existing mixed-chunk class
fzyzcjy
committed

Commits on Jun 6, 2026

Commits on Jun 7, 2026

Commits on Jun 8, 2026

Commits on Jun 9, 2026

Merge remote-tracking branch 'upstream/main' into tom/scripted_runtime_and_chunked_testing
fzyzcjy
committed