https://github.com/jxltom/scrapyd-heroku

Wrapper for running Scrapyd in Heroku or locally as a service
https://github.com/jxltom/scrapyd-heroku

heroku scrapy scrapyd scrapyd-heroku

Last synced: 17 days ago
JSON representation

Wrapper for running Scrapyd in Heroku or locally as a service

• Host: GitHub
• URL: https://github.com/jxltom/scrapyd-heroku
• Owner: jxltom
• License: mit
• Created: 2017-02-19T13:52:59.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2020-11-28T02:04:50.000Z (about 4 years ago)
• Last Synced: 2024-11-13T06:16:43.037Z (about 1 month ago)
• Topics: heroku, scrapy, scrapyd, scrapyd-heroku
• Language: Python
• Homepage: https://scrapyd-heroku.herokuapp.com/
• Size: 44.9 KB
• Stars: 19
• Watchers: 4
• Forks: 36
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGES
  • License: LICENSE

Awesome Lists containing this project

README

        
# scrapyd-heroku

Wrapper for running [Scrapyd](https://github.com/scrapy/scrapyd) in [Heroku](https://heroku.com/) or locally as a service

## Features

- Support running Scrapyd service in Heroku

- Support running Scrapyd service locally

- Support latest version of Scrapy ```2.4.1``` and Scrapyd ```1.2.1```

    

## Getting Started

- Simply [fork this repository](https://github.com/jxltom/scrapyd-heroku/fork), update custom configurations in ```scrapy.conf```, and deploy it to Heroku

- Or [![Deploy](https://www.herokucdn.com/deploy/button.svg)](https://heroku.com/deploy?template=https://github.com/jxltom/scrapyd-heroku) from this repo directly, and then the service will be exposed such as in ```https://scrapyd-heroku.herokuapp.com/```

- Or ```pip install scrapyd-heroku``` and run ```scrapyd-heroku``` locally

- Or [clone this repository](https://github.com/jxltom/scrapyd-heroku.git) and run ```python manage.py``` locally