- craw relays by requesting through a network of proxies to not get ratelimited (for example, by cloudflare ~5 seconds).
- maintain an in-memory list of endpoints that are predicted to be cached, so only use the ones that are predicted to be uncached.
- proxymesh: rotating anonynous http proxy servers
This repository was archived by the owner on Mar 1, 2025. It is now read-only.