Skip to content

Commit c457a3b

Browse files
committed
docs: README — jev-auto System One routing mode
- TL;DR: single-pass calibrated routing callout - How Routing Works: two-engines table (auto vs jev-auto), distill/train commands, A3M_JEV_URL remote backend
1 parent da2ae95 commit c457a3b

1 file changed

Lines changed: 17 additions & 0 deletions

File tree

‎README.md‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -100,6 +100,11 @@ response = client.chat.completions.create(
100100

101101
**Result:** Simple questions cost 300x less. Complex queries still go to premium models when needed.
102102

103+
**New — System One routing (`model="jev-auto"`):** a single-pass, calibrated
104+
decision head distilled from the heuristic router — ~2ms, 97.8% agreement,
105+
per-choice probabilities, and it scores **unseen providers** through their
106+
text (dynamic option sets). Falls back to the full router below p<0.22.
107+
103108
---
104109

105110
## 🚀 Performance Benchmarks
@@ -175,6 +180,18 @@ Then routes to the right tier:
175180
| **Mid** | GPT-4o-mini, Claude-haiku | Standard tasks |
176181
| **Premium** | GPT-4o, Claude-sonnet, Gemini | Complex reasoning |
177182

183+
### Two routing engines
184+
185+
| Mode | Engine | Latency | Notes |
186+
|------|--------|---------|-------|
187+
| `model="auto"` | Heuristic System 2 (features + EXP3 diversity) | ~0.4ms | Default |
188+
| `model="jev-auto"` | **System One** option-attention head | ~2ms warm | Calibrated probs, dynamic option sets, confidence-guarded fallback to `auto` |
189+
190+
The Jev head ([open System One interface pattern](https://huggingface.co/harshatheg/Qwen-2.5-1B-RLCD))
191+
is distilled from the heuristic router via `npm run jev:distill && npm run jev:train`.
192+
Optionally point it at a Jev-compatible server ([openjev-sglang](https://github.com/ekzhang/openjev-sglang)
193+
or api.typesafe.ai) with `A3M_JEV_URL`.
194+
178195
---
179196

180197
## Provider Coverage

0 commit comments

Comments
 (0)