Search results

Improve llm-d-kv-cache Observability for Metrics, Tracing Coverage, Alerting, and Dashboards

Status: Open.

#617 In llm-d/llm-d-kv-cache;

· gyliu513 opened on May 28, 2026

[fs-backend] Track feature gaps in upstream vLLM fs_python secondary tier vs llmd_fs_backend

Status: Open.

#616 In llm-d/llm-d-kv-cache;

· kfirtoledo opened on May 28, 2026

pvc_evictor deletion leavs large amount of empty directories, slowing down file discovery.

Status: Open.

#614 In llm-d/llm-d-kv-cache;

· miroslavln opened on May 27, 2026

EPD Disaggregation: CPU NIXL EC Connector

Status: Open.

#602 In llm-d/llm-d-kv-cache;

· omerpaz95 opened on May 21, 2026

Add pure-Python filesystem secondary tier to offloading connector + FileMapper utility

Status: Open.

#599 In llm-d/llm-d-kv-cache;

· rshavitt opened on May 20, 2026

Extend PD connector to cover generic P2P

Status: Open.

#598 In llm-d/llm-d-kv-cache;

· liranschour opened on May 20, 2026

Create object store based secondary tier offloading connector

Status: Open.

#597 In llm-d/llm-d-kv-cache;

· effi-ofer opened on May 20, 2026

Stale latest Docker image tag

Status: Open.

#581 In llm-d/llm-d-kv-cache;

· revit13 opened on May 10, 2026

Tool calls are dropped before tokenization which breaks KV cache block indexing

Status: Open.

#573 In llm-d/llm-d-kv-cache;

· shashwatj07 opened on May 6, 2026

Wire fs_backend Python tests into CI

Status: Open.

#572 In llm-d/llm-d-kv-cache;

· yankay opened on May 6, 2026

Enable PYTHONOPTIMIZE=1

Status: Open.

#570 In llm-d/llm-d-kv-cache;

· effi-ofer opened on May 5, 2026

build(fs_connector): ship cp38-abi3 stable-ABI wheels (currently locked to cp312)

Status: Open.

#567 In llm-d/llm-d-kv-cache;

· kfirtoledo opened on May 3, 2026