10K downloads in 14 days β the three problems we fixed π
·
312 commits
to main
since this release
10,024 downloads in 14 days. Zero marketing.
What happened
Developers kept hitting the same three LLM infrastructure problems. We built the fix.
The three problems
1. LLM bills are 3-5x too high
Smart routing saves 62% on API costs. Measured across 200 real calls.
2. Sequential fallback is broken
Parallel ensemble runs providers simultaneously, scores results, returns the best. Nobody else does this.
3. No real benchmarks
Published third-party latency data from llm-gateway-bench. 138ms baseline β 374ms through full routing.
Stats
- 72 versions, 14 days
- 10,024 npm downloads
- 47 providers
- 19.5 KB gzipped
- Zero ML dependencies
Try it
npm install adaptive-memory-multi-model-router
npx a3m-router serveFull benchmarks: https://github.com/Das-rebel/a3m-router/blob/main/docs/BENCHMARK.md