Scraping MLS Competition for Appearances by Player

[naveenelliott]

Hello, great job on the web scraper it's very good! I had a specific question about scraping appearances by player just for MLS, do you know the best place to start with this? Thanks!

[dcaribou]

Hi @naveenelliott.
You could create a competitions.json file that includes the MLS competition. From there you could crawl clubs, players and appearances like it's explained in the readme.

cat competitions.json \
    | scrapy crawl clubs \
    | scrapy crawl players \
    | scrapy crawl appearances