crawler_pic

A python multiprocess crawler study case for crawling meitulu.com

Depends

requests module

Use

To creater a folder in d: to store pictures that named "crawler" python spider.py example_url: https://www.meitulu.cn/t/minidamengmeng/

Config

You can select to open or off the proxy and change the proxy,I use the https://www.abuyun.com/ for proxy

Result