Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-scrapy
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
https://github.com/AccordBox/awesome-scrapy
- Portia
- scrapy-cluster
- scrapy-redis - based components for Scrapy.
- scrapyscript - **no project required.**
- scrapyd
- scrapyd-client
- python-scrapyd-api
- SpiderKeeper
- scrapyrt
- Gerapy - Client, Scrapyd-API, Django and Vue.js
- SpiderKeeper
- ScrapydWeb
- scrapy-sentry
- scrapy-statsd-middleware
- scrapy-jsonrpc - RPC
- scrapy-fieldstats
- spidermon
- HttpProxyMiddleware
- scrapy-proxies
- scrapy-rotating-proxies
- scrapy-random-useragent - Agent for every Request.
- scrapy-fake-useragent - Agent middleware based on fake-useragent
- scrapy-crawlera
- scrapy-elasticsearch
- scrapy-mongodb
- scrapy-mysql-pipeline
- scrapy-s3pipeline
- scrapy-sqs-exporter
- scrapy-kafka-export
- scrapy-rss-exporter
- scrapy-playwright
- scrapy-puppeteer - rendered pages.
- scrapy-splash
- scrapy-djangoitem
- scrapy-deltafetch
- scrapy-crawl-once - crawling pages which were already downloaded in previous crawls.
- scrapy-magicfields
- scrapy-pagestorage
- itemloaders
- itemadapter
- scrapy-poet
- Scrapy VS Beautiful Soup
- Scrapy VS Selenium
- Web Scraping in Python using Scrapy (with multiple examples)
- Scrapy Tutorial Series: Web Scraping Using Python
- Advanced Web Scraping: Bypassing "403 Forbidden," captchas, and more
- Learn and improve web scraping skills with Web Scraping Exercises
- Scrapy: Powerful Web Scraping & Crawling with Python
- Learning Scrapy
Programming Languages
Keywords
scrapy
18
python
8
scraping
5
crawler
4
distributed
3
spider
3
scrapyd
3
dashboard
3
crawling
3
python3
3
proxy
2
hacktoberfest2021
2
scrapyd-ui
2
redis
2
scrapyd-control
1
scrapyd-cluster-management
1
scrapyd-api
1
scrapyd-admin
1
scrapy-visualization
1
scrapy-log-analysis
1
log-parsing
1
scrapyd-keeper
1
log-analysis
1
webspider
1
scrapyd-log-analysis
1
vuejs
1
vue
1
gerapy
1
docker
1
django
1
webcrawling
1
webcrawler
1
twisted
1
scraper
1
scrapy-spider
1
api-wrapper
1
kafka
1
pipeline
1
s3
1
sqs
1
chrome-headless
1
firefox-headless
1
headless-browser
1
javascript-renderer
1
playwright
1
playwright-python
1
python-asyncio
1
webkit-headless
1
puppeteer
1
headless-browsers
1