https://github.com/aborn/spaceweb

This project is based on scrapy and used to crawl information from web.
https://github.com/aborn/spaceweb

Last synced: 30 days ago
JSON representation

This project is based on scrapy and used to crawl information from web.

• Host: GitHub
• URL: https://github.com/aborn/spaceweb
• Owner: aborn
• Created: 2013-11-23T05:27:00.000Z (almost 11 years ago)
• Default Branch: master
• Last Pushed: 2015-11-08T15:34:18.000Z (about 9 years ago)
• Last Synced: 2023-06-17T08:40:18.415Z (over 1 year ago)
• Language: Python
• Size: 1.16 MB
• Stars: 3
• Watchers: 2
• Forks: 7
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
spaceweb

========

## INTRODUCTION

This project is based on scrapy and used to crawl information from web.

First of all, assue you have installed scrapy.

## USAGE

1. install python 2.7 

2. install scrapy (ref ./deps/install.sh)

3. runing table (in spiders) using following cmd

   * $scrapy crawl spaceweb

## AUTHOR

Aborn Jiang ([email protected])

## VERSION

* 2013-11-23 v0.1

* 2015-11-08 v0.2