https://github.com/work-design/rails_spider

爬虫
https://github.com/work-design/rails_spider

design engine work

Last synced: about 1 year ago
JSON representation

爬虫

• Host: GitHub
• URL: https://github.com/work-design/rails_spider
• Owner: work-design
• License: mit
• Created: 2017-05-11T03:02:04.000Z (about 9 years ago)
• Default Branch: main
• Last Pushed: 2023-12-11T10:48:10.000Z (over 2 years ago)
• Last Synced: 2025-03-15T16:03:51.074Z (over 1 year ago)
• Topics: design, engine, work
• Language: Ruby
• Homepage:
• Size: 170 KB
• Stars: 1
• Watchers: 0
• Forks: 0
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# RailsSpider

`RailsSpider`是一个面向运营人员的爬虫管理工具，大部分情况下不需要写代码，仅仅通过后台一些简单的配置，便能够添加新的站点；

`RailsSpider`基于[kimurai](https://github.com/vifreefly/kimuraframework)这个优秀的ruby爬虫通用框架。

## 特性

* 面向运营人员；

## todo

-[] 添加并发支持；

-[] 添加代理支持；