| pr | 1937 |
|---|---|
| url | llm-d#1937 |
| author | nilig |
| date | 2026-07-14 |
The routing sidecar honors the x-kv-cache-source-host-port header, injecting kv_transfer_params.remote_kv_source so vLLM pulls cached prefix KV from the named peer over the OffloadingConnector P2P tier instead of recomputing it.