Skip to content
This repository was archived by the owner on Apr 17, 2026. It is now read-only.

v1.15.0 - Throttling-Aware API Management

Latest

Choose a tag to compare

@dpsifr dpsifr released this 08 Aug 14:45

πŸš€ What's New

Throttling-Aware API Management

  • Upgraded to @soulcraft/brainy v0.58.0 with comprehensive throttling metrics
  • Intelligently pauses GitHub API calls when storage is throttled
  • Prevents unnecessary API quota usage and reduces costs
  • Implements exponential backoff (1s to 60s) for smooth recovery
  • Automatically resumes data collection once storage recovers

Benefits

  • πŸ’° Cost savings by avoiding API calls when data can't be stored
  • πŸ›‘οΈ Protects API quotas from unnecessary consumption
  • ⚑ More efficient resource utilization
  • πŸ”„ Automatic recovery without manual intervention

Technical Details

  • New checkStorageThrottling() method monitors Brainy's throttling metrics
  • Integration with both crawlAllUsers() and crawlAllRepositories() methods
  • Real-time throttle state tracking with consecutive failure counting
  • Seamless integration with existing rate limiting mechanisms