Skip to content

Commit 098c531

Browse files
committed
docs: add benchmark chart + publish independent latency data
- Added benchmark-chart.png: dual-panel dark-theme chart Left: latency comparison (Direct→A3M forced→A3M auto) Right: cost savings projection (1K to 1M queries/mo) - Chart embedded in both README.md and docs/BENCHMARK.md - Everything measured with llm-gateway-bench v0.2.0 (third-party tool) - Full methodology and reproduce instructions in docs/BENCHMARK.md
1 parent c6b0277 commit 098c531

3 files changed

Lines changed: 5 additions & 1 deletion

File tree

‎README.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1085,6 +1085,8 @@ Expert queries (legal, medical, complex reasoning) are routed to **premium** —
10851085

10861086
Measured with [llm-gateway-bench](https://github.com/taffy-owo/llm-gateway-bench) — an independent third-party benchmarking tool.
10871087

1088+
![A3M Router Benchmark](docs/benchmark-chart.png)
1089+
10881090
| Scenario | TTFT | vs Baseline | What You Get |
10891091
|:---------|:----:|:-----------:|:-------------|
10901092
| **Direct to Groq** (no gateway) | **138ms** | — | Raw provider speed |

‎docs/BENCHMARK.md‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,9 @@
44

55
**The answer:** +96ms for passthrough, +236ms for full intelligent routing — on a 138ms baseline.
66

7-
Everything below explains exactly where those milliseconds go, and why they're worth it.
7+
![A3M Router Benchmark](benchmark-chart.png)
8+
9+
*Left: latency comparison. Right: cost savings projection. Dark theme.*
810

911
---
1012

‎docs/benchmark-chart.png‎

135 KB
Loading

0 commit comments

Comments
 (0)