You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Brand: cat mark image in app and docs; cap max active jobs at 2
- Add cat.png to frontend/public and docs; use img for brand mark
- Docs topbar uses ./cat.png with object-fit
- Align CRAWL_MAX_ACTIVE_JOBS parse max with hard cap; document in README/.env.example
- Fly: max_machines_running = 2
Made-with: Cursor
Copy file name to clipboardExpand all lines: README.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -92,6 +92,7 @@ Important operational constraints:
92
92
- Staging and production must use `JOB_STATE_BACKEND=firestore`
93
93
- All production instances must share the same Firestore backend and collection prefix
94
94
- Crawl jobs are rate-limited and capped by backend hard limits
95
+
- Active crawl jobs are hard-capped to `2` (`CRAWL_MAX_ACTIVE_JOBS`)
95
96
- Frontend controls are aligned to the backend caps: `maxPages` up to `300`, `concurrency` up to `6`
96
97
- The crawler is for public `http(s)` targets only; internal, loopback, link-local, and metadata destinations are blocked
97
98
- Crawling stays on the same host as the start URL
@@ -237,6 +238,7 @@ GitHub Pages only serves the static docs and bookmarklet loader; crawls still ru
237
238
### Fly.io (optional)
238
239
239
240
[`fly.toml`](fly.toml) is only relevant if you choose to deploy with [Fly.io](https://fly.io/) instead of (or in addition to) Cloud Run. Ignore it if you use Cloud Run only.
241
+
The project Fly config caps running machines at `2` via `max_machines_running = 2`.
0 commit comments