https://github.com/zwzch/fluent-plugin-pulsar
fluent pulsar input
https://github.com/zwzch/fluent-plugin-pulsar
Last synced: 6 months ago
JSON representation
fluent pulsar input
- Host: GitHub
- URL: https://github.com/zwzch/fluent-plugin-pulsar
- Owner: zwzch
- License: apache-2.0
- Created: 2019-11-16T06:34:07.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2019-11-16T06:34:40.000Z (almost 6 years ago)
- Last Synced: 2024-11-19T06:53:05.476Z (12 months ago)
- Language: Ruby
- Size: 17.6 KB
- Stars: 6
- Watchers: 1
- Forks: 2
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-pulsar - zwzch/fluent-plugin-pulsar - plugin-pulsar connector to support copying data between Pulsar and Fluent. (Connectors)
README
# fluent-plugin-pulsar
[Fluentd](https://fluentd.org/) input plugin to do
as pulsar sink
## Installation
### RubyGems
```
gem install bundler
gem install fluentd
gem install digest-crc
gem install ruby_protobuf
```
## Compile Pulsar API protocol buffer
1. Clone proto file(PulsarApi.proto) from Pulsar Project page.
```
git clone https://github.com/apache/pulsar.git
```
(The proto file path is at pulsar-common/src/main/proto/PulsarApi.proto)
2. Compile the proto file using rprotoc
```
rprotoc PulsarApi.proto
```
3. Move PulsarApi.pb.rb to your project directory.
4. copy lib/fluent/plugin/lib/* to your plugin dir.
## Configuration
```
example:
$ fluent.conf
@type pulsar
@id pulsar_input
tag debug.access
pulsar_port 6650
pulsar_host 127.0.0.1
pulsar_topic my-topic
pulsar_subscription sub
pull_duration 0.1
@type stdout
@id stdout_output
```
## Copyright
* Copyright(c) 2019- zhengwei01
* License
* Apache License, Version 2.0
## Thanks
+ [ruby-pulsar-client](https://github.com/hiroakiwater/ruby-pulsar-client)