How do I set up the rate limiting since the CrawlerRunConfig class no longer has rate limit parameters? #1091
Unanswered
steelliberty
asked this question in
Forums - Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
CrawlerRunConfig: class - described in CrawlerRunConfig Essentials has parameters that are not actually in the latest class. The class shown in the section of the docs call CrawlerRunConfig Essentials shows the parameters below. But the class no longer supports those parameters.
enable_rate_limiting=False,
rate_limit_config=None,
How do I setup rate limiting? There is a RateLimit class described and a section on how to use the class but there is no actual documentation on how to use them now that the CrawlerRunConfig no longer supports the configuration.
Thank you
Beta Was this translation helpful? Give feedback.
All reactions