https://github.com/zwzch/fluent-plugin-pulsar

fluent pulsar input
https://github.com/zwzch/fluent-plugin-pulsar

Last synced: 24 days ago
JSON representation

fluent pulsar input

• Host: GitHub
• URL: https://github.com/zwzch/fluent-plugin-pulsar
• Owner: zwzch
• License: apache-2.0
• Created: 2019-11-16T06:34:07.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2019-11-16T06:34:40.000Z (about 5 years ago)
• Last Synced: 2024-08-04T04:01:10.131Z (4 months ago)
• Language: Ruby
• Size: 17.6 KB
• Stars: 6
• Watchers: 1
• Forks: 2
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-pulsar - zwzch/fluent-plugin-pulsar - plugin-pulsar connector to support copying data between Pulsar and Fluent. (Connectors)

README

        
# fluent-plugin-pulsar

[Fluentd](https://fluentd.org/) input plugin to do 

as pulsar sink

## Installation

### RubyGems

```

gem install bundler

gem install fluentd

gem install digest-crc

gem install ruby_protobuf

```

## Compile Pulsar API protocol buffer

1. Clone proto file(PulsarApi.proto) from Pulsar Project page.

```

git clone https://github.com/apache/pulsar.git

```

(The proto file path is at pulsar-common/src/main/proto/PulsarApi.proto)

2. Compile the proto file using rprotoc

```

rprotoc PulsarApi.proto

```

3. Move PulsarApi.pb.rb to your project directory.

4. copy lib/fluent/plugin/lib/* to your plugin dir.

## Configuration

```

example:

$ fluent.conf

  @type pulsar

  @id pulsar_input

  tag debug.access

  pulsar_port 6650

  pulsar_host 127.0.0.1

  pulsar_topic my-topic

  pulsar_subscription sub

  pull_duration 0.1

    @type stdout

    @id stdout_output

```

## Copyright

* Copyright(c) 2019- zhengwei01

* License

  * Apache License, Version 2.0

## Thanks

+ [ruby-pulsar-client](https://github.com/hiroakiwater/ruby-pulsar-client)