Skip to content

10K downloads in 14 days β€” the three problems we fixed πŸš€

Choose a tag to compare

@Das-rebel Das-rebel released this 27 May 14:12
· 312 commits to main since this release

10,024 downloads in 14 days. Zero marketing.

What happened

Developers kept hitting the same three LLM infrastructure problems. We built the fix.

The three problems

1. LLM bills are 3-5x too high
Smart routing saves 62% on API costs. Measured across 200 real calls.

2. Sequential fallback is broken
Parallel ensemble runs providers simultaneously, scores results, returns the best. Nobody else does this.

3. No real benchmarks
Published third-party latency data from llm-gateway-bench. 138ms baseline β†’ 374ms through full routing.

Stats

  • 72 versions, 14 days
  • 10,024 npm downloads
  • 47 providers
  • 19.5 KB gzipped
  • Zero ML dependencies

Try it

npm install adaptive-memory-multi-model-router
npx a3m-router serve

Full benchmarks: https://github.com/Das-rebel/a3m-router/blob/main/docs/BENCHMARK.md