Skip to content

Commit 6520ecc

Browse files
committed
docs: update README tagline and architecture with all 3 bio features
- Tagline now mentions biology-inspired provider selection - Added one-liner for each mechanism (EXP3, Charnov MVT, ODT) - Architecture section lists all three mechanisms by name
1 parent 760b468 commit 6520ecc

1 file changed

Lines changed: 6 additions & 3 deletions

File tree

‎README.md‎

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
# A3M Router
22

3-
**Universal LLM routing gateway — routes requests to the cheapest capable provider across 47+ models.**
3+
**Universal LLM routing gateway with biology-inspired provider selection — routes requests to the cheapest capable model across 47+ providers.**
44

5-
A3M Router is a stateless proxy between your application and 47+ LLM providers. It inspects each request, estimates how complex it is, and routes it to the cheapest capable provider — without retraining a model or managing GPU infrastructure.
5+
A3M Router is a stateless proxy between your application and 47+ LLM providers. It inspects each request, estimates how complex it is, and routes it to the cheapest capable provider — without retraining a model or managing GPU infrastructure. Provider selection is guided by ecological theory: EXP3 prevents monoculture, Charnov MVT optimizes rate-limit rotation, and Optimal Defense Theory allocates shadow verification to high-stakes queries.
66

77
The API uses the OpenAI format (same endpoints, same request/response shapes), so existing SDKs and prompts work without changes. But it routes across any provider you configure, not just OpenAI.
88

@@ -116,7 +116,10 @@ Request → Guardrails → Cache → Router → Provider → Response
116116

117117
**Semantic Cache** — Optional. Uses embedding similarity to return cached responses for repeated queries. Cache hit = instant response, zero provider cost.
118118

119-
**Router** — Scores the query, selects tier, picks the cheapest healthy provider in that tier. Model quality scores update online via exponential moving average after each real call — no retraining. Includes EXP3 diversity weighting to prevent monoculture and MVT rate-limit rotation to avoid depleted providers.
119+
**Router** — Scores the query, selects tier, picks the cheapest healthy provider in that tier. Model quality scores update online via exponential moving average after each real call — no retraining. Three biologically-inspired mechanisms run inside the router:
120+
- **EXP3 diversity weighting** — negative frequency-dependent selection prevents any provider from dominating traffic (no competitive exclusion)
121+
- **Charnov MVT rate-limit rotation** — optimal departure time from depleting rate-limit windows
122+
- **ODT shadow sampler** — probabilistically verifies high-stakes queries proportional to query value (tissue value) and risk (attack probability)
120123

121124
**Ensemble** — Optional. Calls multiple providers in parallel, scores responses on specificity and structure, returns the winner.
122125

0 commit comments

Comments
 (0)