Skip to content

Limit Requests to Prevent 429 from Google #17

Open
@threeal

Description

This issue addresses the need to limit Google search requests to avoid encountering HTTP 429 errors. The following changes will be implemented to achieve this:

  • Modify the code to make requests sequentially, ensuring that one request is made after another.
  • Introduce a random delay between requests to avoid overwhelming the Google search service.
  • Add a --rapid option that allows making requests in parallel without any delay between them.

These changes aim to prevent HTTP 429 errors, which occur when there are too many requests made to Google within a short period. By implementing these modifications, we can ensure a more reliable and sustainable interaction with the Google search service, mitigating the risk of encountering rate-limiting issues.

Metadata

Assignees

No one assigned

    Labels

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions