https://github.com/gerapy/gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

dashboard distributed django docker gerapy scrapy scrapyd spider vue vuejs webspider

Last synced: 12 May 2025

https://github.com/Gerapy/Gerapy

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

dashboard distributed django docker gerapy scrapy scrapyd spider vue vuejs webspider

Last synced: 14 Mar 2025

https://github.com/gerapy/gerapyautoextractor

Auto Extractor Module

Last synced: 12 Apr 2025

https://github.com/gerapy/gerapypyppeteer

Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

Last synced: 09 Apr 2025

https://github.com/gerapy/gerapyplaywright

Downloader Middleware to support Playwright in Scrapy & Gerapy

Last synced: 08 May 2025

https://github.com/gerapy/gerapyselenium

Downloader Middleware to support Selenium in Scrapy & Gerapy

Last synced: 07 Apr 2025

https://github.com/gerapy/gerapyproxy

A package for supporting proxy in Scrapy & Gerapy

Last synced: 07 Apr 2025

https://github.com/gerapy/gerapyrabbitmq

Distribution Support for Scrapy & Gerapy using RabbitMQ

Last synced: 07 Apr 2025

https://github.com/gerapy/gerapyredis

Distribution Support for Scrapy & Gerapy using Redis

Last synced: 07 Apr 2025

https://github.com/gerapy/docs

Document of Gerapy

Last synced: 12 Apr 2025

https://github.com/gerapy/gerapyprometheusexporter

Gerapy Prometheus Exporter

Last synced: 07 Apr 2025

https://github.com/gerapy/acinonyx

A package which can simplify your multiprocessing implementation

Last synced: 12 Apr 2025

https://github.com/gerapy/gerapyitempipeline

Item Pipeline Components for Gerapy & Scrapy

Last synced: 07 Apr 2025