https://github.com/Gerapy/Gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
https://github.com/Gerapy/Gerapy

dashboard distributed django docker gerapy scrapy scrapyd spider vue vuejs webspider

Last synced: about 2 months ago
JSON representation

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

• Host: GitHub
• URL: https://github.com/Gerapy/Gerapy
• Owner: Gerapy
• License: mit
• Created: 2017-06-30T03:58:27.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2024-04-12T01:52:02.000Z (8 months ago)
• Last Synced: 2024-04-14T08:31:48.726Z (8 months ago)
• Topics: dashboard, distributed, django, docker, gerapy, scrapy, scrapyd, spider, vue, vuejs, webspider
• Language: Python
• Homepage: https://docs.gerapy.com/
• Size: 39.9 MB
• Stars: 3,206
• Watchers: 124
• Forks: 618
• Open Issues: 66
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

• awesome - Gerapy - Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js (Scrapy Distributed)
• awesome-scrapy - Gerapy - Client, Scrapyd-API, Django and Vue.js (Apps / Front-End Scrapy Managers)
• awesome-hacking-lists - Gerapy/Gerapy - Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js (Python)
• best-of-web-python - GitHub - 30% open · ⏱️ 23.05.2024): (Web Scraping & Crawling)