Skip to content

v2.16.3 — Jev System One routing (model=jev-auto)

Choose a tag to compare

View all tags
@Das-rebel Das-rebel released this 19 Sep 11:16
· 8 commits to main since this release
v2.16.3
a7aadbb

What's new

🧠 System One routing — model="jev-auto"

Single-pass, calibrated routing decisions via the open Jev / System One interface pattern:

  • Option-attention engine (pure TS, zero deps, hashed-trigram embeddings): scores all providers in one forward pass — ~2ms warm, 100% schema-valid, calibrated probabilities
  • 97.8% agreement with the full heuristic router (distilled), temperature-calibrated to honest 0.90 mean top-prob
  • Dynamic option sets — unseen providers scored through their text (name + strengths + tier)
  • Confidence guard: below p<0.22 → automatic System 2 fallback
  • Remote backend: point at openjev-sglang or api.typesafe.ai via A3M_JEV_URL
  • Retrain pipeline: npm run jev:distill && npm run jev:train

Fixes

  • restore package-lock.json (CI was red since v2.16.1)
  • track dist/routing/jev/ (was gitignored → MODULE_NOT_FOUND in CI)
  • lazy guarded import in modelMapper (graceful fallback without weights)

Companion release: imprint v0.5 — same engine gating the cache/compress fallback chain, cross-compatible weights.

Assets 2
Loading