https://github.com/casual-silva/NewsCrawl
狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑
https://github.com/casual-silva/NewsCrawl
apscheduler docker python scrapy scrapy-crawler scrapyd scrapydweb script spider web
Last synced: about 8 hours ago
JSON representation
狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑
- Host: GitHub
- URL: https://github.com/casual-silva/NewsCrawl
- Owner: casual-silva
- Created: 2022-07-08T08:01:18.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2024-01-12T16:51:34.000Z (about 2 years ago)
- Last Synced: 2024-01-13T08:06:59.038Z (about 2 years ago)
- Topics: apscheduler, docker, python, scrapy, scrapy-crawler, scrapyd, scrapydweb, script, spider, web
- Language: Python
- Homepage:
- Size: 15.2 MB
- Stars: 402
- Watchers: 6
- Forks: 119
- Open Issues: 6
-
Metadata Files:
- Readme: README.md