Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/tungct/tngtcrawler
Crawler using Scrapy
https://github.com/tungct/tngtcrawler
crawler python scrapy
Last synced: 28 days ago
JSON representation
Crawler using Scrapy
- Host: GitHub
- URL: https://github.com/tungct/tngtcrawler
- Owner: tungct
- Created: 2017-10-10T06:08:45.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2017-11-26T05:28:42.000Z (about 7 years ago)
- Last Synced: 2025-01-14T08:21:52.736Z (28 days ago)
- Topics: crawler, python, scrapy
- Language: Python
- Size: 2.42 MB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# TNGTCrawler
Crawler using Scrapy1. Install Scrapy :
https://doc.scrapy.org/en/latest/intro/install.html
2. Run Crawler :
2.1 : cd crawler/spider
scrapy crawl zing -o data.csv -t csv
2.2 : cd crawler/spider
run file zing.sh