https://github.com/mrxujiang/crawel

基于Apify+node+react搭建的有点意思的爬虫平台
https://github.com/mrxujiang/crawel

apify crawler node puppeteer react react-hooks umi umi3

Last synced: about 2 months ago
JSON representation

基于Apify+node+react搭建的有点意思的爬虫平台

• Host: GitHub
• URL: https://github.com/mrxujiang/crawel
• Owner: MrXujiang
• License: mit
• Created: 2020-05-14T03:17:00.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-05-14T03:42:22.000Z (over 4 years ago)
• Last Synced: 2024-04-14T00:31:48.529Z (9 months ago)
• Topics: apify, crawler, node, puppeteer, react, react-hooks, umi, umi3
• Language: JavaScript
• Homepage:
• Size: 9.09 MB
• Stars: 39
• Watchers: 5
• Forks: 17
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

        
## 基于Apify+node+react搭建的有点意思的爬虫平台

> 该平台可以用来爬取任意网页的数据, 网页全屏截图(网页快照), 并对爬取到的数据进行管理, 操作等.开发者也可以自行进行扩展, 作为爬虫管理平台的基础服务.

## 技术实现

* 前端采用umi集成开发环境, 框架选用react+antd;

* 后端采用nodejs + koa, 爬虫框架采用Apify;

* node多进程开发模式

## 项目截图





## 开源交流与反馈