feat: cache resolved model info and support per-endpoint engine API keys#26

Merged

niklasfrick merged 10 commits into

mainfrom

feat/api-optimizations-and-metrics

May 19, 2026

Commits on May 19, 2026

feat: cache resolved model info and support per-endpoint engine API keys
niklasfrick
committed
feat: plot prefix cache hit rate alongside KV cache over time
niklasfrick
committed
feat: add Time Per Output Token (TPOT) to engine latency card
niklasfrick
committed
feat: add cumulative token totals to engine throughput cards
niklasfrick
committed
feat: surface cumulative prefix cache queries on engine cache card
niklasfrick
committed
feat: select physical/Wi-Fi network interface instead of loopback
niklasfrick
committed
feat: move tok/s into engine throughput titles and fix hover header
niklasfrick
committed
feat: bracket chart units in titles and clean up hover tooltips
niklasfrick
committed
feat: hide tooltip header on prefill and decode throughput charts too
niklasfrick
committed
chore(deps): update all dependencies to latest stable
niklasfrick
committed