https://github.com/mrxujiang/crawel
基于Apify+node+react搭建的有点意思的爬虫平台
https://github.com/mrxujiang/crawel
apify crawler node puppeteer react react-hooks umi umi3
Last synced: 15 days ago
JSON representation
基于Apify+node+react搭建的有点意思的爬虫平台
- Host: GitHub
- URL: https://github.com/mrxujiang/crawel
- Owner: MrXujiang
- License: mit
- Created: 2020-05-14T03:17:00.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2020-05-14T03:42:22.000Z (almost 5 years ago)
- Last Synced: 2025-04-12T19:23:27.540Z (16 days ago)
- Topics: apify, crawler, node, puppeteer, react, react-hooks, umi, umi3
- Language: JavaScript
- Homepage:
- Size: 9.09 MB
- Stars: 41
- Watchers: 5
- Forks: 16
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
## 基于Apify+node+react搭建的有点意思的爬虫平台
> 该平台可以用来爬取任意网页的数据, 网页全屏截图(网页快照), 并对爬取到的数据进行管理, 操作等.开发者也可以自行进行扩展, 作为爬虫管理平台的基础服务.## 技术实现
* 前端采用umi集成开发环境, 框架选用react+antd;
* 后端采用nodejs + koa, 爬虫框架采用Apify;
* node多进程开发模式## 项目截图
![]()
## 开源交流与反馈