burst prefix-cache affinity for prompt-sharing requests#1727

Merged

elevran merged 18 commits into

ezrasilvera:burst-scorer-longest-prefix

Jul 6, 2026

Commits on Jun 22, 2026

refactor(prefix): extract block-hashing into shared prefixhash package
ezrasilvera
committed
feat(prefix): add burst prefix cache producer for grouped requests
ezrasilvera
committed

Commits on Jun 23, 2026

Commits on Jul 2, 2026

fix(burstprefix): stop longest-prefix walk at first unheld block
ezrasilvera
committed
refactor(burstprefix): stabilize prefix key and share hash encoding
ezrasilvera
committed
feat(burstprefix): log when assigned replica is absent from request pods
ezrasilvera
committed
feat(burstprefix): cap batch size with maxBatchSize config
ezrasilvera
committed
feat(burstprefix): log per-request batch window wait time
ezrasilvera
committed
fix(burstprefix): reject window and prefix-token misconfigurations
ezrasilvera
committed
perf(burstprefix): precompute prefix-block counts for unit sorting
ezrasilvera
committed
perf(burstprefix): avoid throwaway slice when placing units
ezrasilvera
committed
docs(burstprefix): explain the less tiebreaker signal choice
ezrasilvera
committed
docs(burstprefix): use cluster-DNS placeholder in deploy sample
ezrasilvera
committed
test(burstprefix): set maxBatchSize in producer construction tests
ezrasilvera
committed
test(burstprefix): cover cancelled-context and second-window paths
ezrasilvera
committed
test(burstprefix): cover single-replica and cap-overflow placement
ezrasilvera
committed