https://github.com/scrapy/scrapyd

A service daemon to run Scrapy spiders
https://github.com/scrapy/scrapyd

Last synced: about 15 hours ago
JSON representation

A service daemon to run Scrapy spiders

• Host: GitHub
• URL: https://github.com/scrapy/scrapyd
• Owner: scrapy
• License: bsd-3-clause
• Created: 2013-02-01T19:06:43.000Z (almost 12 years ago)
• Default Branch: master
• Last Pushed: 2024-12-18T18:59:30.000Z (about 1 month ago)
• Last Synced: 2025-01-11T16:00:09.454Z (8 days ago)
• Language: Python
• Homepage: https://scrapyd.readthedocs.io/en/stable/
• Size: 941 KB
• Stars: 2,984
• Watchers: 92
• Forks: 570
• Open Issues: 7
• Metadata Files:
  • Readme: README.rst
  • Contributing: docs/contributing/api.rst
  • License: LICENSE

Awesome Lists containing this project

• awesome - scrapyd - A service daemon to run Scrapy spiders (Python)
• awesome-scrapy - scrapyd

README

        
|PyPI Version| |Build Status| |Coverage Status| |Python Version| |Pypi Downloads|

Scrapyd is a service for deploying and running `Scrapy `__ spiders.

It allows you to upload Scrapy projects and control their spiders using a JSON API.

(If you are viewing this on GitHub, open the `full documentation `__ for additional details.)

.. |PyPI Version| image:: https://img.shields.io/pypi/v/scrapyd.svg

   :target: https://pypi.org/project/scrapyd/

.. |Build Status| image:: https://github.com/scrapy/scrapyd/workflows/Tests/badge.svg

.. |Coverage Status| image:: https://coveralls.io/repos/github/scrapy/scrapyd/badge.svg?branch=master

   :target: https://coveralls.io/github/scrapy/scrapyd?branch=master

.. |Python Version| image:: https://img.shields.io/pypi/pyversions/scrapyd.svg

   :target: https://pypi.org/project/scrapyd/

.. |Pypi Downloads| image:: https://img.shields.io/pypi/dm/scrapyd.svg

   :target: https://pypi.python.org/pypi/scrapyd/