https://github.com/pabluk/ec2-scrapyd

User data script to deploy scrapyd on Amazon EC2
https://github.com/pabluk/ec2-scrapyd

Last synced: about 7 hours ago
JSON representation

User data script to deploy scrapyd on Amazon EC2

• Host: GitHub
• URL: https://github.com/pabluk/ec2-scrapyd
• Owner: pabluk
• Created: 2013-03-13T22:55:57.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2013-03-27T15:11:26.000Z (over 11 years ago)
• Last Synced: 2024-06-13T20:27:18.559Z (5 months ago)
• Language: Python
• Size: 109 KB
• Stars: 22
• Watchers: 5
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
ec2-scrapyd

===========

User data script to deploy scrapyd on Amazon EC2

Based on this blog post http://pabloseminario.com/2013/03/26/running-scrapy-on-amazon-ec2/

Usage

-----

Install `boto` on a virtualenv:

    $ pip install boto

add your AWS credentials in `~/.boto` or see the [Boto Config tutorial](http://boto.readthedocs.org/en/latest/boto_config_tut.html)

edit your options in `ec2-launcher.py` and run:

    $ vim ec2-launcher.py

    $ python ec2-launcher.py