https://github.com/work-design/rails_spider
爬虫
https://github.com/work-design/rails_spider
design engine work
Last synced: about 1 year ago
JSON representation
爬虫
- Host: GitHub
- URL: https://github.com/work-design/rails_spider
- Owner: work-design
- License: mit
- Created: 2017-05-11T03:02:04.000Z (about 9 years ago)
- Default Branch: main
- Last Pushed: 2023-12-11T10:48:10.000Z (over 2 years ago)
- Last Synced: 2025-03-15T16:03:51.074Z (over 1 year ago)
- Topics: design, engine, work
- Language: Ruby
- Homepage:
- Size: 170 KB
- Stars: 1
- Watchers: 0
- Forks: 0
- Open Issues: 5
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# RailsSpider
`RailsSpider`是一个面向运营人员的爬虫管理工具,大部分情况下不需要写代码,仅仅通过后台一些简单的配置,便能够添加新的站点;
`RailsSpider`基于[kimurai](https://github.com/vifreefly/kimuraframework)这个优秀的ruby爬虫通用框架。
## 特性
* 面向运营人员;
## todo
-[] 添加并发支持;
-[] 添加代理支持;