Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/tungct/tngtcrawler

Crawler using Scrapy
https://github.com/tungct/tngtcrawler

crawler python scrapy

Last synced: 28 days ago
JSON representation

Crawler using Scrapy

Awesome Lists containing this project

README

        

# TNGTCrawler
Crawler using Scrapy

1. Install Scrapy :
https://doc.scrapy.org/en/latest/intro/install.html

2. Run Crawler :
2.1 : cd crawler/spider
scrapy crawl zing -o data.csv -t csv
2.2 : cd crawler/spider
run file zing.sh