https://github.com/taizilongxu/scrapy_jingdong

用scrapy写的京东爬虫
https://github.com/taizilongxu/scrapy_jingdong

Last synced: 5 days ago
JSON representation

用scrapy写的京东爬虫

• Host: GitHub
• URL: https://github.com/taizilongxu/scrapy_jingdong
• Owner: taizilongxu
• Created: 2014-09-07T12:04:26.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2014-12-05T11:37:00.000Z (about 10 years ago)
• Last Synced: 2024-12-22T15:09:56.361Z (12 days ago)
• Language: Python
• Size: 28.2 MB
• Stars: 441
• Watchers: 29
• Forks: 316
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
scrapy crawl test -s JOBDIR=data -0 items.csv

watch -n 1 -d 'wc -l items.csv;du -h items.csv'

附数据 items.csv

![](img.png)

http://hackerxu.com/2014/09/07/scrapy-jd.html