https://github.com/nodefluent/mqtt-to-kafka-bridge

Move your messages from MQTT to Apache Kafka in real-time :rocket:
https://github.com/nodefluent/mqtt-to-kafka-bridge

bridge etl kafka mirror mqtt

Last synced: about 2 months ago
JSON representation

Move your messages from MQTT to Apache Kafka in real-time :rocket:

• Host: GitHub
• URL: https://github.com/nodefluent/mqtt-to-kafka-bridge
• Owner: nodefluent
• License: mit
• Created: 2018-10-05T12:24:18.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2022-12-08T21:45:42.000Z (about 2 years ago)
• Last Synced: 2024-04-14T07:54:11.792Z (9 months ago)
• Topics: bridge, etl, kafka, mirror, mqtt
• Language: JavaScript
• Homepage:
• Size: 83 KB
• Stars: 37
• Watchers: 3
• Forks: 23
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# mqtt-to-kafka-bridge - consume, (etl/mirror), produce

[![npm version](https://badge.fury.io/js/mqtt-to-kafka-bridge.svg)](https://badge.fury.io/js/mqtt-to-kafka-bridge)

[![Docker Repository on Quay](https://quay.io/repository/nodefluent/mqtt-to-kafka-bridge/status "Docker Repository on Quay")](https://quay.io/repository/nodefluent/mqtt-to-kafka-bridge)

## Intro

`mqtt-to-kafka-bridge` allows you to quickly setup a fast (about messages 2 million/sec) and lightweight (about 100 MB RAM)

bridge that subscribes to your MQTT Broker and produces messages to your Apache Kafka cluster.

You can configure **routing** (move messags from MQTT topics to certain Kafka topics) or filtering, as well as **ETL functions**

on MQTT consume, as well as on Kafka produce. You just pass everything in a simple JSON/JS config object.

## How to use?

Just check out the example [here](example/sample.js) it also gives you description on the configuration options.

You can find the sample configuration [here](example/config.js).

## Info

The bridge spins up an http server, which can be used to check its health status `http://localhost:3967/healthcheck` as well as statistics `http://localhost:3967/stats`.

## Maintainer

Build with :heart: :pizza: and :coffee: by [nodefluent](https://github.com/nodefluent)