Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists by scrapy-plugins

A curated list of projects in awesome lists by scrapy-plugins .

https://github.com/scrapy-plugins/scrapy-splash

Scrapy+Splash for JavaScript integration

headless-browsers scrapy

Last synced: 31 Jul 2024

https://github.com/scrapy-plugins/scrapy-djangoitem

Scrapy extension to write scraped items using Django models

Last synced: 03 Aug 2024

https://github.com/scrapy-plugins/scrapy-zyte-smartproxy

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

crawler crawler-detection plugin proxy scraping scrapy

Last synced: 30 Jul 2024

https://github.com/scrapy-plugins/scrapy-crawlera

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

crawler crawler-detection plugin proxy scraping scrapy

Last synced: 05 Sep 2024

https://github.com/scrapy-plugins/scrapy-jsonrpc

Scrapy extension to control spiders using JSON-RPC

Last synced: 03 Aug 2024

https://github.com/scrapy-plugins/scrapy-deltafetch

Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

hacktoberfest hacktoberfest2021

Last synced: 30 Jul 2024

https://github.com/scrapy-plugins/scrapy-magicfields

Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.

Last synced: 30 Jul 2024

https://github.com/scrapy-plugins/scrapy-pagestorage

A scrapy extension to store requests and responses information in storage service

Last synced: 03 Aug 2024

https://github.com/scrapy-plugins/scrapy-splitvariants

Scrapy spider middleware to split an item into multiple items using a multi-valued key

Last synced: 30 Jul 2024