https://github.com/peopledoc/crappyspider

https://github.com/peopledoc/crappyspider

approved-public ghec-mig-migrated

Last synced: 17 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/peopledoc/crappyspider
• Owner: peopledoc
• Created: 2014-10-24T14:06:39.000Z (about 10 years ago)
• Default Branch: master
• Last Pushed: 2015-02-16T11:09:27.000Z (almost 10 years ago)
• Last Synced: 2024-04-16T06:52:48.118Z (9 months ago)
• Topics: approved-public, ghec-mig-migrated
• Language: Python
• Size: 463 KB
• Stars: 4
• Watchers: 10
• Forks: 0
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • Changelog: Changes
  • Contributing: CONTRIBUTING.rst

Awesome Lists containing this project

README

        
# Introduction

Crappyspider is a generic cralwer. The goal is to stay kiss and simple, test

easily your site. A report is generate with all visited url and can be used by

other tool to make functional test.

# Install

The project is available on pypi:

    pip install crappyspider

Or from source:

    python setup.py install

# USAGE

Then you can run a spider:

    scrapy crawl crappyspider -a config=my_rule.json

See http://crappyspider.readthedocs.org/en/latest/ for further information.