https://github.com/my8100/files
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
https://github.com/my8100/files
scrapy scrapyd scrapydweb
Last synced: 5 months ago
JSON representation
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
- Host: GitHub
- URL: https://github.com/my8100/files
- Owner: my8100
- Created: 2018-11-18T16:48:17.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2025-03-01T05:46:56.000Z (7 months ago)
- Last Synced: 2025-04-07T03:19:27.277Z (6 months ago)
- Topics: scrapy, scrapyd, scrapydweb
- Homepage:
- Size: 16.7 MB
- Stars: 420
- Watchers: 17
- Forks: 71
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# [ScrapydWeb](https://github.com/my8100/scrapydweb)
### [:computer: UI Preview 预览](https://scrapydweb.pythonanywhere.com/)
### [:book: How to efficiently manage your distributed web scraping projects](./scrapydweb/README.md)
### [:book: How to set up Scrapyd cluster on Heroku](https://github.com/my8100/scrapyd-cluster-on-heroku)
### [:book: Native support for basic auth finally comes to Scrapyd after a 5-year wait](./scrapyd-basic-auth/README.md)
### [:book: 如何简单高效地部署和监控分布式爬虫项目](./scrapydweb/README_CN.md)
### [:book: 如何免费创建云端爬虫集群](https://github.com/my8100/scrapyd-cluster-on-heroku/blob/master/README_CN.md)
### [:book: 时隔五年，Scrapyd 终于原生支持 basic auth](./scrapyd-basic-auth/README_CN.md)