A crawler for download cabu kaohsiung data.
##How to install it##
-
You must install Scrapy first. You can find how to install scrapy in Scrapy Install Guide.
-
use git to clone this project.
git clone https://github.com/codeforkaohsiung/CabuKcgCrawler.git
-
use follow commands to prepare to run.
git submodule init git submodule update
-
you can crawel data as follow.
scrapy list scrapy crawel District scrapy crawel 61B3
all you crawel data will write to /data folder