Issues · llm-d/llm-d-inference-payload-processor

the models config hot-reload does not work with ConfigMap volume mounts

llm-d/llm-d-inference-payload-processor#319 · opened

on Sep 15, 2026

Non-streaming responses return empty body: Content-Length not set on passthrough response path (asymmetric with request handler)

llm-d/llm-d-inference-payload-processor#307 · opened

on Aug 31, 2026

tracing: OTEL_TRACES_EXPORTER=none is silently treated as console

llm-d/llm-d-inference-payload-processor#305 · opened

on Aug 31, 2026

Runner: support per-object cache namespace scoping (ByObject)

llm-d/llm-d-inference-payload-processor#300 · opened

on Aug 26, 2026

WIP POC: content-aware routing via a Scorer plugin + llm-d-sc — findings and benchmarks

llm-d/llm-d-inference-payload-processor#299 · opened

on Aug 25, 2026

feat(framework): align FactoryFunc signature with EPP (json.RawMessage → *json.Decoder)

llm-d/llm-d-inference-payload-processor#293 · opened

on Aug 12, 2026

2

feat(framework): adopt request attributes and remove CycleState

llm-d/llm-d-inference-payload-processor#288 · opened

on Aug 11, 2026

5

feat(framework): import shared plugin types from llm-d-router

llm-d/llm-d-inference-payload-processor#287 · opened

on Aug 11, 2026

1

Typos detected by nightly scan (1 found)

llm-d/llm-d-inference-payload-processor#282 · opened

on Aug 6, 2026

1

[Bug] datalayer.Model serializes as {} in structured logs in picker/selector

llm-d/llm-d-inference-payload-processor#280 · opened

on Aug 5, 2026

1

CI pipeline hardening

llm-d/llm-d-inference-payload-processor#274 · opened

on Jul 29, 2026

3

Access-control plugin for IPP

llm-d/llm-d-inference-payload-processor#246 · opened

on Jul 16, 2026

3

[Feature] IPP Unified Multi-Model & External Provider Routing

llm-d/llm-d-inference-payload-processor#239 · opened

on Jul 14, 2026

1

[documentation] model group filter documentation update

llm-d/llm-d-inference-payload-processor#236 · opened

on Jul 13, 2026

llmd-router-metrics-collector to collect metrics from inference pools

llm-d/llm-d-inference-payload-processor#235 · opened

on Jul 12, 2026

1

[Feature] Add RequestCostMetadataExtractor plugin

llm-d/llm-d-inference-payload-processor#231 · opened

on Jul 12, 2026

1

Large FULL_DUPLEX_STREAMED bodies corrupted: duplicate EndOfStream chunk appended to processed buffer

llm-d/llm-d-inference-payload-processor#224 · opened

on Jul 9, 2026

2

[EPIC] Reuse the llm-d-router EPP plugin framework

llm-d/llm-d-inference-payload-processor#221 · opened

on Jul 8, 2026

1

[EPIC] Multi-cluster llm-d: hub and spoke inference routing

llm-d/llm-d-inference-payload-processor#220 · opened

on Jul 8, 2026

1

[EPIC] External Model Routing

llm-d/llm-d-inference-payload-processor#219 · opened

on Jul 8, 2026

7

[EPIC] Multi-Model Serving

llm-d/llm-d-inference-payload-processor#218 · opened

on Jul 8, 2026

3

[Feature] InferencePool discovery

llm-d/llm-d-inference-payload-processor#216 · opened

on Jul 7, 2026

1

[Feature] Model Selection by Actual Cost of Inference

llm-d/llm-d-inference-payload-processor#214 · opened

on Jul 6, 2026

3

docs(plugins): add README.md documentation for all in-tree plugins

llm-d/llm-d-inference-payload-processor#213 · opened

on Jul 6, 2026

1

bug: ext_proc body parsing fails on chunked Transfer-Encoding requests

llm-d/llm-d-inference-payload-processor#209 · opened

on Jul 2, 2026

4