README

Setup Instructions
Obtain your ScraperAPI key
Visit ScraperAPI and sign up to get your API key. This key allows your scraper to access web pages reliably by handling proxies, CAPTCHAs, and JavaScript rendering.

Configure your API key
After obtaining the key, add it to your project’s .env file as follows:


Running the Scraper
Clone the project repository

git clone <repository-url>
cd src/

Run the scraper with command-line arguments
Use the following command format to scrape reviews for a specific product and source within a date range:

python main.py <company_name> <start_date> <end_date> <source>


company_name: Name of the company/product (e.g., asana)

start_date: Start date in YYYY-MM-DD format (e.g., 2024-01-01)

end_date: End date in YYYY-MM-DD format (e.g., 2025-04-23)

source: Review platform (g2, capterra, or getapp)

python main.py asana 2024-01-01 2025-04-23 g2


asana_g2_reviews.json