[Feature Request]: Add max_scroll_steps parameter to CrawlerRunConfig

[ruanjunmin]

What needs to be done?

Proposed Solution:

``` class CrawlerRunConfig: def __init__( ..., max_scroll_steps: Optional[int] = None, # New parameter scroll_delay: float = 0.2, # Existing ): """ max_scroll_steps: Maximum scroll operations (None=unlimited) scroll_delay: Existing delay between scrolls """ ```

Validation Approach:

Can reuse the session reuse mechanism2 and multi-step interaction pattern3 already proven in:

``` async with AsyncWebCrawler() as crawler: await crawler.arun(config=CrawlerRunConfig(max_scroll_steps=3)) # Test case ```

What problem does this solve?

Documentation Alignment:

The change will finally implement what's already documented in Lazy-Loading section:

"Heavier Pages: Adjust scroll_delay or the max scroll steps as needed"

Target users/beneficiaries

No response

Current alternatives/workarounds

No response

Proposed approach

No response

[ntohidi]

I have implemented this feature, and it is in the 2025-JUN-1 branch. You can help check it out. 💜

[ruanjunmin]

Thank you so much! I'll go check out later