Skip to content

Commit b0836b5

Browse files
committed
feat(observability): align dashboard with llm-d-router metrics
Rewrite panel queries to the llm_d_router_epp_* metric subsystem and the per-endpoint queue labels (name, model_server_endpoint). Drop the Body Based Router panels: llm-d-router emits no bbr_* metrics. Point the DEVELOPMENT.md dashboard reference at the bundled JSON. Signed-off-by: Luke Van Drie <lukevandrie@google.com>
1 parent 891860a commit b0836b5

2 files changed

Lines changed: 39 additions & 445 deletions

File tree

DEVELOPMENT.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -169,14 +169,14 @@ PROM_ENABLED=true KIND_PROM_HOST_PORT=30091 make env-dev-kind
169169

170170
### Grafana Dashboard
171171

172-
The upstream [Inference Gateway dashboard] covers EPP, inference pool, and vLLM metrics.
172+
The bundled [Inference Gateway dashboard] covers EPP, inference pool, and vLLM metrics.
173173

174174
Add a Prometheus datasource at `http://localhost:30090`, then import the JSON via
175175
**Dashboards > New > Import**. See the
176176
[Grafana installation docs](https://grafana.com/docs/grafana/latest/setup-grafana/installation/)
177177
for setup.
178178

179-
[Inference Gateway dashboard]:https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/tools/dashboards/inference_gateway.json
179+
[Inference Gateway dashboard]:tools/dashboards/inference_gateway.json
180180

181181
> [!NOTE]
182182
> For significant customization beyond the standard deployment, use the `deploy/components`

0 commit comments

Comments
 (0)