Overview

This repository store some example to learn scrapy better, which include tutorial, zhihu, cnbeta, xiaobaihe, douban, coursera

Requirements

$ git clone git@github.com:Andrew-liu/scrapy_example.git

You can use the six scrapy simply, just to do below:

$ cd zhuhu  #into some one scarpy
$ scrapy crwal zhihu  #xiaobaihe or tutorial or cnbeta or xiaobaihe, coursera

If you want to store the result into the format of json, just to do :

$ scrapy crwal zhihu -o filename.json

Licensed under the MIT License