This repository was archived by the owner on Apr 17, 2026. It is now read-only.
π What's New
Throttling-Aware API Management
- Upgraded to @soulcraft/brainy v0.58.0 with comprehensive throttling metrics
- Intelligently pauses GitHub API calls when storage is throttled
- Prevents unnecessary API quota usage and reduces costs
- Implements exponential backoff (1s to 60s) for smooth recovery
- Automatically resumes data collection once storage recovers
Benefits
- π° Cost savings by avoiding API calls when data can't be stored
- π‘οΈ Protects API quotas from unnecessary consumption
- β‘ More efficient resource utilization
- π Automatic recovery without manual intervention
Technical Details
- New
checkStorageThrottling()method monitors Brainy's throttling metrics - Integration with both
crawlAllUsers()andcrawlAllRepositories()methods - Real-time throttle state tracking with consecutive failure counting
- Seamless integration with existing rate limiting mechanisms