https://github.com/backto17/SinaHouseCrawler

基于scrapy,scrapy-redis实现的一个分布式网络爬虫,爬取了新浪房产的楼盘信息及户型图片,实现了常用的爬虫功能需求.
https://github.com/backto17/SinaHouseCrawler

Last synced: 22 days ago
JSON representation

基于scrapy,scrapy-redis实现的一个分布式网络爬虫,爬取了新浪房产的楼盘信息及户型图片,实现了常用的爬虫功能需求.

• Host: GitHub
• URL: https://github.com/backto17/SinaHouseCrawler
• Owner: backto17
• Created: 2016-02-24T10:05:38.000Z (almost 9 years ago)
• Default Branch: master
• Last Pushed: 2017-02-13T09:24:56.000Z (almost 8 years ago)
• Last Synced: 2024-08-05T17:42:28.073Z (4 months ago)
• Language: Python
• Homepage:
• Size: 106 KB
• Stars: 39
• Watchers: 9
• Forks: 26
• Open Issues: 1

Awesome Lists containing this project

• awesome-hacking-lists - backto17/SinaHouseCrawler - 基于scrapy,scrapy-redis实现的一个分布式网络爬虫,爬取了新浪房产的楼盘信息及户型图片,实现了常用的爬虫功能需求. (Python)