This project is a robust web scraper designed to collect and store property sales values and other pertinent details about properties.
🕸️ Data is scraped from Casamineira, a leading real estate website.
Developed with Python 3.x, this project makes use of powerful libraries and tools, including:
- Scrapy 🕷️
- BeautifulSoup 🍲
These instructions will get you a copy of the project up and running on your local machine.
Ensure you have Python 3.x installed on your system. You can download it here.
-
Create a Virtual Environment
Start by creating a new virtual environment to isolate the dependencies for this project.
$ python -m venv env $ source env/bin/activate -
Install dependencies:
$ pip install -r requirements.txt -
🚀 Running the Scraper:
$ scrapy crawl myspider
This will initiate the scraper, and data will begin being collected from Casamineira!
Happy data hunting! 📊