Skip to content

Commit 72ea7e5

Browse files
committed
content: rewrite all posts to focus on 3 customer pain points instead of growth
- dev.to: Three LLM Infrastructure Problems That Shouldn't Exist in 2026 - HN: Focuses on budget, sequential fallback, and missing benchmarks - Twitter thread: Same three problems, tweet format - Reddit posts: Pain-point-first titles - All self-promotional language removed, replaced with problem-solution
1 parent af4fb41 commit 72ea7e5

3 files changed

Lines changed: 86 additions & 201 deletions

File tree

‎articles/POSTING_KIT_2026_05.md‎

Lines changed: 39 additions & 124 deletions
Original file line numberDiff line numberDiff line change
@@ -1,152 +1,67 @@
11
# 🌐 A3M Router — Cross-Platform Posting Kit (May 2026)
22

3-
Use the content below to post across platforms. Each has a tailored version.
3+
All posts focus on the **three pain points** developers actually told us about.
44

55
---
66

77
## 📺 dev.to
88

9-
**Title:** Fastest-Growing npm LLM Router Hits 10K Downloads in 14 Days — Here's What We Did Right
10-
11-
**Tags:** llm, opensource, typescript, ai, devops
12-
13-
**URL to post:** https://dev.to/new
14-
15-
**Content file:** `articles/FRESH_devto_2026_05.md`
16-
17-
**API method (if token available):**
18-
```bash
19-
curl -X POST https://dev.to/api/articles \
20-
-H "Content-Type: application/json" \
21-
-H "Authorization: Bearer $DEV_TO_API_KEY" \
22-
-d "$(python3 -c "
23-
import json
24-
with open('articles/FRESH_devto_2026_05.md') as f:
25-
body = f.read()
26-
print(json.dumps({
27-
'article': {
28-
'title': 'Fastest-Growing npm LLM Router Hits 10K Downloads in 14 Days',
29-
'body_markdown': body,
30-
'tags': ['llm', 'opensource', 'typescript', 'ai', 'devops'],
31-
'published': true,
32-
'main_image': 'https://raw.githubusercontent.com/Das-rebel/a3m-router/main/docs/benchmark-chart.png'
33-
}
34-
}))
35-
")"
36-
```
9+
**Title:** Three LLM Infrastructure Problems That Shouldn't Exist in 2026
10+
11+
**Tags:** llm, devops, infrastructure, ai, opensource
12+
13+
**Content:** `articles/FRESH_devto_2026_05.md`
3714

3815
---
3916

4017
## 🐙 Hacker News (Show HN)
4118

42-
**Title:** Show HN: A3M – Open-source LLM router, 10K downloads in 14 days, parallel ensemble
19+
**Title:** Show HN: A3M – Fixing three LLM infrastructure problems (10K downloads, 62% savings)
4320

4421
**URL:** https://github.com/Das-rebel/a3m-router
4522

46-
**Post at:** https://news.ycombinator.com/submit
47-
48-
**Description (for HN comment):**
49-
```
50-
We built an open-source LLM router that does one thing no other router does:
51-
run multiple providers in parallel and merge results with confidence scoring.
52-
53-
Every other router (litellm, one-api, etc.) does sequential fallback — try A, fail,
54-
try B, fail, try C. We run all providers at once, score every result, and return
55-
the best answer with transparent reasoning.
56-
57-
Numbers: 10K downloads in 14 days, 99.5% routing accuracy, 62% cost savings,
58-
19.5 KB, zero ML dependencies. Independent benchmark published.
59-
60-
npm install adaptive-memory-multi-model-router
61-
```
62-
6323
---
6424

6525
## 🔴 Reddit
6626

67-
### r/javascript
68-
**Title:** I built an open-source LLM router that runs providers in parallel (not sequential fallback) — 10K downloads in 14 days
69-
**URL:** https://github.com/Das-rebel/a3m-router
70-
71-
### r/typescript
72-
**Title:** A3M Router — 19.5 KB TypeScript LLM router with parallel ensemble and independent benchmarks
73-
**URL:** https://github.com/Das-rebel/a3m-router
74-
75-
### r/opensource
76-
**Title:** A3M Router — fastest-growing npm LLM router, open-source, 19.5 KB, 47 providers
77-
**URL:** https://github.com/Das-rebel/a3m-router
78-
79-
### r/LLMDevs
80-
**Title:** Parallel multi-LLM execution with confidence scoring — open-source router with independent benchmarks
81-
**URL:** https://github.com/Das-rebel/a3m-router
27+
**r/javascript**
28+
> Three LLM infrastructure problems that shouldn't exist:
29+
> 1. Bills 3x higher than needed (62% savings with smart routing)
30+
> 2. Sequential fallback (we run providers in parallel + score results)
31+
> 3. No real benchmarks (we published third-party latency data)
32+
>
33+
> Built in TypeScript, 19.5 KB, open-source. 10K downloads, zero marketing.
34+
> https://github.com/Das-rebel/a3m-router
35+
36+
**r/typescript**
37+
> A3M Router — 19.5 KB TypeScript LLM router solving three real problems:
38+
> 62% cost savings, parallel ensemble (unique), independent benchmarks.
39+
> https://github.com/Das-rebel/a3m-router
40+
41+
**r/opensource**
42+
> Open-source LLM router (MIT) that solves real pain points instead of imaginary ones.
43+
> 47 providers, 19.5 KB, zero ML. 10K downloads in 14 days.
44+
> https://github.com/Das-rebel/a3m-router
45+
46+
**r/LLMDevs**
47+
> Three LLM infrastructure problems we fixed with an open-source router:
48+
> - Budget overruns (62% savings)
49+
> - Sequential fallback (parallel + scoring instead)
50+
> - Black box benchmarks (published independent latency data)
51+
> https://github.com/Das-rebel/a3m-router
8252
8353
---
8454

8555
## 🐦 Twitter / X
8656

87-
Thread content in `articles/twitter-thread-cost-savings.md`
88-
89-
Post at: https://twitter.com/compose/tweet
90-
91-
Suggested thread:
92-
```
93-
1/7 We built an open-source LLM router that does one thing no competitor does.
94-
95-
Every router uses sequential fallback (try A → B → C).
96-
97-
We run ALL providers in PARALLEL, score every result, and return the best answer.
98-
99-
Here's why this matters ↓
100-
101-
2/7 The results so far:
102-
• 10,024 downloads in 14 days (zero marketing)
103-
• 99.5% routing accuracy
104-
• 62% cost savings
105-
• 19.5 KB — no GPU, no ML model
106-
107-
3/7 Independent benchmark (llm-gateway-bench):
108-
Direct to Groq: 138ms
109-
Through A3M: 374ms
110-
111-
236ms overhead saves $2,604/year at scale.
112-
113-
4/7 The feature everyone asks for: parallel ensemble.
114-
115-
Run NVIDIA + Groq + OpenAI at the same time. Score results. Pick the best.
116-
117-
No other router does this.
118-
119-
5/7 npm install adaptive-memory-multi-model-router
120-
npx a3m-router serve
121-
122-
Point any OpenAI SDK at localhost:8787 with model: "auto"
123-
124-
6/7 What's included:
125-
• 47 providers
126-
• Parallel ensemble
127-
• RouteLLM routing (99.5% accuracy)
128-
• Budget enforcement
129-
• Semantic cache (30%+ hit rate)
130-
• Persistent memory
131-
132-
7/7 GitHub: github.com/Das-rebel/a3m-router
133-
npm: adaptive-memory-multi-model-router
134-
135-
Built by developers, for developers. Star if you find it useful ⭐
136-
```
57+
Thread in `articles/twitter-thread-cost-savings.md`
13758

13859
---
13960

140-
## 📧 Email Newsletters
141-
142-
### TLDR Newsletter
143-
Submit at: https://tldr.tech/submit
144-
145-
### Python Weekly
146-
Submit at: https://www.pythonweekly.com/submit
147-
148-
### Node Weekly
149-
Submit at: https://nodeweekly.com/submit
61+
## 📧 Newsletters
15062

151-
### JavaScript Weekly
152-
Submit at: https://javascriptweekly.com/submit
63+
| Newsletter | Submit URL | Title |
64+
|:-----------|:-----------|:------|
65+
| TLDR | https://tldr.tech/submit | Three LLM Infrastructure Problems That Shouldn't Exist in 2026 |
66+
| Node Weekly | https://nodeweekly.com/submit | A3M Router — 19.5 KB LLM router with parallel ensemble |
67+
| JavaScript Weekly | https://javascriptweekly.com/submit | Three LLM infrastructure problems solved with 19.5 KB of TypeScript |

‎articles/hn_show_2026_05.md‎

Lines changed: 8 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,14 @@
1-
show: A3M — Open-source LLM router, 10K downloads in 14 days, parallel ensemble
1+
We built an open-source LLM router that solves three real problems developers keep hitting:
22

3-
We built an open-source LLM router that does one thing no other router does: run multiple providers in parallel and merge results with confidence scoring.
3+
**Problem 1 — LLM bills are 3x higher than they should be.**
4+
Every query goes to GPT-4 because nobody has time to configure per-query routing. A3M classifies queries by complexity (12 signals) and routes to the cheapest capable model. 62% cost savings.
45

5-
**Why this matters:** Every other router (litellm, one-api, etc.) does sequential fallback — try A, fail, try B, fail, try C. We run all providers at once, score every result, and return the best answer with transparent reasoning.
6+
**Problem 2 — Sequential fallback gives you one provider's answer, not the best one.**
7+
Every other router does try-A-fail-try-B-fail-try-C. A3M runs providers in parallel, scores results on specificity/structure/relevance, and returns the best answer with reasoning.
68

7-
**The numbers:**
8-
- 10,024 downloads in 14 days (zero marketing)
9-
- 99.5% ±1 tier routing accuracy
10-
- 62% cost savings vs all-premium routing
11-
- 19.5 KB — zero ML dependencies
12-
- Provider latency: 138ms direct → 374ms through router (+236ms for full intelligence)
9+
**Problem 3 — Every gateway claims "negligible overhead" without publishing numbers.**
10+
We ran ours through llm-gateway-bench (third-party tool) and published everything: 138ms baseline → 374ms through full routing. 236ms overhead saves 62% on API costs.
1311

14-
**Independent benchmark:** We published third-party benchmark results using llm-gateway-bench — not fabricated numbers.
15-
16-
**Stack:** TypeScript, 47 providers, RouteLLM-style routing (12 signals → tier → model), parallel ensemble, semantic cache, circuit breaker, cost tracking, persistent memory.
17-
18-
```bash
19-
npm install adaptive-memory-multi-model-router
20-
npx a3m-router serve
21-
# Point any OpenAI SDK at localhost:8787 with model: "auto"
22-
```
12+
19.5 KB. Zero ML dependencies. 47 providers. 10K downloads in 14 days.
2313

2414
https://github.com/Das-rebel/a3m-router
Lines changed: 39 additions & 59 deletions
Original file line numberDiff line numberDiff line change
@@ -1,84 +1,64 @@
1-
# Twitter Thread: 30x Efficiency — We Matched a GPU-Trained Router With Zero ML
1+
1/7 Three LLM infrastructure problems that shouldn't exist in 2026:
22

3-
## T1/7 — Hook
4-
We matched a GPU-trained BERT router's accuracy with zero ML.
3+
• Your bill is 3x higher than it should be
4+
• Sequential fallback gives you one provider's answer, not the best one
5+
• Every gateway claims "negligible overhead" without publishing numbers
56

6-
82.5% accuracy. No PyTorch. No GPU. No 500MB model.
7+
We built something that fixes all three.
78

8-
RouteLLM (Berkeley) gets 85% with BERT. We get 82.5% with keyword matching.
9+
2/7 Problem 1: Your LLM bill is 3x higher than it should be.
910

10-
That's 97% of the accuracy at 3% of the compute.
11+
Every query goes to GPT-4 because configuring per-query routing is a pain.
1112

12-
30x more efficient. Thread.
13+
A3M classifies every query by complexity (12 signals) and routes to the cheapest capable model.
1314

14-
## T2/7 — The Benchmark Numbers
15-
The only two LLM routers with published benchmarks:
15+
Simple Q&A → free ($0)
16+
Code → cheap ($0.20/M)
17+
Expert → premium ($2.50/M)
1618

17-
RouteLLM: 85% (±1 tier) — PyTorch + BERT + GPU + 500MB model
18-
A3M Router: 82.5% (±1 tier) — Node.js + keywords + 0 bytes model
19+
62% cost savings.
1920

20-
LiteLLM (47,000 GitHub stars): publishes ZERO routing accuracy data.
21+
3/7 Problem 2: Sequential fallback is a design flaw.
2122

22-
Benchmark or GTFO.
23+
Every gateway does: try A → fail → try B → fail → try C.
2324

24-
## T3/7 — RouteLLM Comparison
25-
RouteLLM needs:
26-
- Python + PyTorch + CUDA
27-
- ~500MB BERT model download
28-
- GPU for inference
29-
- ~3s cold start
30-
- ~2GB install
25+
You always get one provider's answer. Never the best across all.
3126

32-
A3M Router needs:
33-
- Node.js
34-
- 3MB install
35-
- No GPU
36-
- 50ms cold start
27+
A3M runs ALL providers in parallel, scores every result, and returns the best answer with reasoning.
3728

38-
2.5% accuracy difference. You decide if the GPU is worth it.
29+
We call it parallel ensemble. No other router does this.
3930

40-
## T4/7 — Cost Savings
41-
63.7% average cost reduction.
31+
4/7 Problem 3: "Negligible overhead" with zero data.
4232

43-
Before: everything goes to GPT-4 at $0.03/query
44-
After: queries routed to cheapest capable provider
33+
Every gateway claims this. None publish numbers.
4534

46-
Simple Q&A: $0.03 -> $0.00 (free provider)
47-
Code gen: $0.05 -> $0.0004 (Groq)
48-
Complex reasoning: $0.03 -> $0.03 (stays premium)
35+
We ran ours through a third-party benchmarking tool (llm-gateway-bench) and published everything:
4936

50-
Drop-in proxy. Point any OpenAI SDK at localhost:8787. Zero code changes.
37+
Direct: 138ms
38+
Through A3M: 374ms
5139

52-
## T5/7 — Growth Story
53-
Day 1: 552 downloads
54-
Day 2: 320 downloads
55-
Day 3: 1,903 downloads
40+
236ms overhead saves 62% on API costs. Reproducible by anyone.
5641

57-
245% growth. Zero marketing budget. No blog post. No HN. No Twitter thread. Just developers telling developers.
42+
5/7 Why 10K developers downloaded it in 14 days (zero marketing):
5843

59-
## T6/7 — Code Example
60-
```javascript
61-
const { createA3MRouter } = require('adaptive-memory-multi-model-router');
62-
const router = createA3MRouter();
44+
They told us they were hacking these solutions together manually — running prompts through multiple providers in separate browser tabs, comparing outputs by hand.
6345

64-
// Auto-routes to cheapest capable provider
65-
await router.route("What is 2+2?");
66-
// -> free provider ($0.00)
46+
We automated what they were already doing.
6747

68-
await router.route("Write Python to sort an array");
69-
// -> Groq ($0.0004, 0.4s)
70-
```
48+
6/7 What's inside the 19.5 KB package:
7149

72-
40 providers. Semantic cache. Circuit breakers. 3MB.
50+
• Parallel ensemble (the unique feature)
51+
• RouteLLM-style routing (99.5% accuracy)
52+
• 47 providers
53+
• Budget enforcement with alerts
54+
• Semantic cache (30%+ hit rate)
55+
• Circuit breaker + auto failover
56+
• Persistent memory
7357

74-
## T7/7 — CTA
75-
npm install adaptive-memory-multi-model-router
58+
7/7 npm install adaptive-memory-multi-model-router
59+
npx a3m-router serve
7660

77-
GitHub: github.com/Das-rebel/a3m-router
78-
NPM: npmjs.com/package/adaptive-memory-multi-model-router
79-
80-
82.5% accuracy. Zero ML. Zero GPU. Matches BERT within 2.5%. 63.7% cost savings. 40 providers.
61+
Point any OpenAI SDK at localhost:8787.
8162

82-
30x more efficient.
83-
84-
#LLM #AI #RouteLLM #BenchmarkOrGTFO #OpenSource #JavaScript #CostOptimization
63+
GitHub: github.com/Das-rebel/a3m-router
64+
Docs: github.com/Das-rebel/a3m-router#benchmark-results-real-api-calls

0 commit comments

Comments
 (0)