-
Notifications
You must be signed in to change notification settings - Fork 85
Open
Description
When running the code after forking, I immediately got the following error:
AttributeError: 'FundaSpider' object has no attribute '_rules'
I solved it by adding the following line to init():
super(FundaSoldSpider, self).__init__(place=place)
The error stopped appearing, but now the following lines show up during scraping, giving an empty json file in the end.
[scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.funda.nl/koop/verkocht/eindhoven/p259/> (referer: None)
[scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (301) to <GET https://www.funda.nl/koop/verkocht/eindhoven/p268/> from <GET http://www.funda.nl/koop/verkocht/eindhoven/p268/>
there are the following possibilities:
- the fix solved the error but broke the scraper
- the fix solved the error, but the scraper does not work on a different aspect.
I'm am not sure which one it is, anyone have any idea on how to get the scraper to work?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels