feat(hs_connectors): add HTTP backend for hidden-states transfer - #1011

Open

minziyu wants to merge 6 commits into

vllm-project:mainfrom

minziyu:feature/hs-http-backend

Commits on Aug 19, 2026

feat(hs_connectors): add HTTP backend for hidden-states transfer

minziyu
and
claude
committed
857ca69
perf(hs_connectors): cut file-backend lock poll interval from 100ms to 20ms

minziyu
and
claude
committed
a127bdd
test(hs_connectors): add e2e roundtrip test for the http backend

minziyu
and
claude
committed
0fb9d90
style: fix ruff lint and format findings in the http backend

minziyu
and
claude
committed
43e1a3f
fix(hs_connectors): address review findings in the http backend

minziyu
and
claude
committed
50657ae

Commits on Aug 20, 2026

perf(serve_hs): raise TCP listen backlog from 5 to 128
minziyu
authored
57c8e40