Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/my8100/files

Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
https://github.com/my8100/files

scrapy scrapyd scrapydweb

Last synced: about 1 month ago
JSON representation

Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

Awesome Lists containing this project

README

        

# [ScrapydWeb](https://github.com/my8100/scrapydweb)

### [:computer: DEMO 演示](https://scrapydweb.herokuapp.com)

### [:book: How to efficiently manage your distributed web scraping projects](./scrapydweb/README.md)

### [:book: How to set up Scrapyd cluster on Heroku](https://github.com/my8100/scrapyd-cluster-on-heroku)

### [:book: Native support for basic auth finally comes to Scrapyd after a 5-year wait](./scrapyd-basic-auth/README.md)

### [:book: 如何简单高效地部署和监控分布式爬虫项目](./scrapydweb/README_CN.md)

### [:book: 如何免费创建云端爬虫集群](https://github.com/my8100/scrapyd-cluster-on-heroku/blob/master/README_CN.md)

### [:book: 时隔五年,Scrapyd 终于原生支持 basic auth](./scrapyd-basic-auth/README_CN.md)