Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/my8100/files
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
https://github.com/my8100/files
scrapy scrapyd scrapydweb
Last synced: about 1 month ago
JSON representation
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
- Host: GitHub
- URL: https://github.com/my8100/files
- Owner: my8100
- Created: 2018-11-18T16:48:17.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2019-06-06T09:57:08.000Z (over 5 years ago)
- Last Synced: 2024-08-01T18:34:35.801Z (3 months ago)
- Topics: scrapy, scrapyd, scrapydweb
- Homepage:
- Size: 16.7 MB
- Stars: 419
- Watchers: 18
- Forks: 71
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# [ScrapydWeb](https://github.com/my8100/scrapydweb)
### [:computer: DEMO 演示](https://scrapydweb.herokuapp.com)
### [:book: How to efficiently manage your distributed web scraping projects](./scrapydweb/README.md)
### [:book: How to set up Scrapyd cluster on Heroku](https://github.com/my8100/scrapyd-cluster-on-heroku)
### [:book: Native support for basic auth finally comes to Scrapyd after a 5-year wait](./scrapyd-basic-auth/README.md)
### [:book: 如何简单高效地部署和监控分布式爬虫项目](./scrapydweb/README_CN.md)
### [:book: 如何免费创建云端爬虫集群](https://github.com/my8100/scrapyd-cluster-on-heroku/blob/master/README_CN.md)
### [:book: 时隔五年,Scrapyd 终于原生支持 basic auth](./scrapyd-basic-auth/README_CN.md)