node-scraper

scrape web page and you can have more persistent solutions

1. config file to specify the urls to scrape
2. define the scraping rules
3. config the output for web scraping, default is cvs. We may support mysql, aws dynamo or any other one you provide the adapter

How to start

1. install phantomjs if you want to scrape some web page generated by js.
2. npm install