Skip to content

v0.1.3
Compare
Choose a tag to compare
@pavelkrusek pavelkrusek released this 24 Oct 16:03
· 35 commits to main since this release
v0.1.3
6e38675

Added

ScrapeOptions dataclass: Introduced the ScrapeOptions dataclass to manage scraping configurations, including the max_parallel_tasks parameter. This allows users to configure the number of concurrent asyncio tasks, enhancing the flexibility and performance of the scraping process.

Changed

Project Structure Refactoring: Refactored the project structure by adding a new models.py module within the scraper package. This module houses shared data classes (ScrapeOptions and ScrapeResult), effectively resolving previous circular import issues and improving code maintainability.

Fixed

Unit Tests Update: Updated and fixed related unit tests to accommodate the new ScrapeOptions configuration.

Assets 2
Loading