Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jcustenborder/flume-ng-rabbitmq
Flume plugin for RabbitMQ
https://github.com/jcustenborder/flume-ng-rabbitmq
flume rabbitmq
Last synced: 2 months ago
JSON representation
Flume plugin for RabbitMQ
- Host: GitHub
- URL: https://github.com/jcustenborder/flume-ng-rabbitmq
- Owner: jcustenborder
- License: apache-2.0
- Created: 2012-06-13T20:22:09.000Z (about 12 years ago)
- Default Branch: master
- Last Pushed: 2023-12-16T16:44:13.000Z (6 months ago)
- Last Synced: 2024-01-23T02:49:01.223Z (5 months ago)
- Topics: flume, rabbitmq
- Language: Java
- Homepage:
- Size: 34.2 KB
- Stars: 59
- Watchers: 10
- Forks: 46
- Open Issues: 7
-
Metadata Files:
- Readme: README.markdown
- License: LICENSE
Lists
- awesome-hadoop - Flume RabbitMQ source and sink
- awesome-hadoop - Flume RabbitMQ source and sink
README
Flume-ng RabbitMQ
========
This project provides both a RabbitMQ source and sink for Flume-NG. To use this plugin with your Flume installation, build from source using
mvn package
and put the resulting jar file in the lib directory in your flume installation.
This project is available under the Apache License.
Configuration of RabbitMQ Source
------
The configuration of RabbitMQ sources requires that you either declare an exchange name or a queue name.
The exchange name option is helpful if you have declared an exchange in RabbitMQ, but want to use a
default named queue. If you have a predeclared queue that you want to receive events from, then you can simply declare
the queue name and leave the exchange name out. Another optional configuration option is the declaration of
topic routing keys that you want to listen to. This is a comma-delimited list.
**Minimal Config Example**
agent1.sources.rabbitmq-source1.channels = ch1
agent1.sources.rabbitmq-source1.type = org.apache.flume.source.rabbitmq.RabbitMQSource
agent1.sources.rabbitmq-source1.hostname = 10.10.10.173
agent1.sources.rabbitmq-source1.queuename = log_jammin
OR
agent1.sources.rabbitmq-source1.exchangename = log_jammin_exchange
**Full Config Example**
agent1.sources.rabbitmq-source1.channels = ch1
agent1.sources.rabbitmq-source1.type = org.apache.flume.source.rabbitmq.RabbitMQSource
agent1.sources.rabbitmq-source1.hostname = 10.10.10.173
agent1.sources.rabbitmq-source1.queuename = log_jammin
OR
agent1.sources.rabbitmq-source1.exchangename = log_jammin_exchange
agent1.sources.rabbitmq-source1.topics = topic1,topic2
agent1.sources.rabbitmq-source1.username = rabbitmquser
agent1.sources.rabbitmq-source1.password = p@$$w0rd!
agent1.sources.rabbitmq-source1.port = 12345
agent1.sources.rabbitmq-source1.virtualhost = virtualhost1
RabbitMQ Sink
------
**Minimal Config Example**
agent1.sinks.rabbitmq-sink1.channels = ch1
agent1.sinks.rabbitmq-sink1.type = org.apache.flume.sink.rabbitmq.RabbitMQSink
agent1.sinks.rabbitmq-sink1.hostname = 10.10.10.173
agent1.sinks.rabbitmq-sink1.queuename = log_jammin
**Full Config Example**
agent1.sinks.rabbitmq-sink1.channels = ch1
agent1.sinks.rabbitmq-sink1.type = org.apache.flume.sink.rabbitmq.RabbitMQSink
agent1.sources.rabbitmq-source1.hostname = 10.10.10.173
agent1.sources.rabbitmq-source1.queuename = log_jammin
agent1.sources.rabbitmq-source1.username = rabbitmquser
agent1.sources.rabbitmq-source1.password = p@$$w0rd!
agent1.sources.rabbitmq-source1.port = 12345
agent1.sources.rabbitmq-source1.virtualhost = virtualhost1
agent1.sources.rabbitmq-source1.exchange = exchange1