https://github.com/w-zengtao/rb-spider
基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing]
https://github.com/w-zengtao/rb-spider
rabbitmq redis ruby spider
Last synced: over 1 year ago
JSON representation
基于 RabbitMQ 中间件的爬虫的 Ruby 实现 [Developing]
- Host: GitHub
- URL: https://github.com/w-zengtao/rb-spider
- Owner: w-zengtao
- License: mit
- Created: 2018-08-04T15:05:06.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2018-10-09T12:56:59.000Z (almost 8 years ago)
- Last Synced: 2025-05-06T01:07:59.953Z (over 1 year ago)
- Topics: rabbitmq, redis, ruby, spider
- Language: Ruby
- Homepage:
- Size: 29.3 KB
- Stars: 13
- Watchers: 1
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE.txt
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
# Spider
[](https://codeclimate.com/github/codeclimate/codeclimate/maintainability) [](https://codebeat.co/projects/github-com-w-zengtao-rb-spider-master) [](https://www.travis-ci.org/w-zengtao/rb-spider)
## Docs
* [EN](https://github.com/w-zengtao/rb-spider/blob/master/docs/README_CN.md)
* [中文](https://github.com/w-zengtao/rb-spider/blob/master/docs/README_CN.md)
## Install
```bash
gem install spider -s https://github.com/w-zengtao/rb-spider
```
## Development
The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
## What I am doing ...
* Confused by how to design the `Timer`
```ruby
# it seems that this is not a good way
def interval seconds
loop do
sleep seconds
end
end
interval do
puts 'the code'
end
```
```ruby
# And then use a thread to polling redis seems good
```
* Create the `Task` class to extend our mission
By every commit, I record my thinking about evolution of this gem