An open API service indexing awesome lists of open source software.

https://github.com/streamdal/kafka-sink-connector

Sink connector that pulls records off of Kakfa topics and funnels them to our collector
https://github.com/streamdal/kafka-sink-connector

Last synced: 3 months ago
JSON representation

Sink connector that pulls records off of Kakfa topics and funnels them to our collector

Awesome Lists containing this project

README

          

# Batch.sh Kafka Sink Connector

The [Kafka sink connector](https://docs.confluent.io/current/connect/devguide.html#sink-tasks) funnels records sent over specified topics to the batch.sh collector service.

[Batch](https://batch.sh) offers the ability to tee any events produced within a Kafka cluster up to a remote collector that can optionally analyze and schemify those events.
These events can then be queried and replayed at target destinations.

[![](https://mermaid.ink/img/eyJjb2RlIjoiZ3JhcGggTFJcblx0QVtQcm9kdWNlcl0gLS0-fHNlbmQgbWVzc2FnZXwgQntLYWZrYSBCcm9rZXJzfVxuXHRCIC0tPiBEW2ZhOmZhLXVzZXIgQ29uc3VtZXIgMV1cblx0QiAtLT4gRVtmYTpmYS11c2VyIENvbnN1bWVyIDJdXG5cdEIgLS0-IEZbZmE6ZmEtdXNlciBDb25zdW1lciAzXVxuICBCIC0tPiBDKGJhdGNoLnNoIGthZmthIHNpbmsgY29ubmVjdG9yKVxuICBDIC0tPiB8bWVzc2FnZXMgb3ZlciB0b3BpY3MgY29uZmlndXJlZCBmb3IgYmF0Y2guc2h8R1soYmF0Y2guc2gga2Fma2EgY29sbGVjdG9yKV1cblx0XHRcdFx0XHQiLCJtZXJtYWlkIjp7InRoZW1lIjoiZGVmYXVsdCJ9LCJ1cGRhdGVFZGl0b3IiOmZhbHNlfQ)](https://mermaid-js.github.io/mermaid-live-editor/#/edit/eyJjb2RlIjoiZ3JhcGggTFJcblx0QVtQcm9kdWNlcl0gLS0-fHNlbmQgbWVzc2FnZXwgQntLYWZrYSBCcm9rZXJzfVxuXHRCIC0tPiBEW2ZhOmZhLXVzZXIgQ29uc3VtZXIgMV1cblx0QiAtLT4gRVtmYTpmYS11c2VyIENvbnN1bWVyIDJdXG5cdEIgLS0-IEZbZmE6ZmEtdXNlciBDb25zdW1lciAzXVxuICBCIC0tPiBDKGJhdGNoLnNoIGthZmthIHNpbmsgY29ubmVjdG9yKVxuICBDIC0tPiB8bWVzc2FnZXMgb3ZlciB0b3BpY3MgY29uZmlndXJlZCBmb3IgYmF0Y2guc2h8R1soYmF0Y2guc2gga2Fma2EgY29sbGVjdG9yKV1cblx0XHRcdFx0XHQiLCJtZXJtYWlkIjp7InRoZW1lIjoiZGVmYXVsdCJ9LCJ1cGRhdGVFZGl0b3IiOmZhbHNlfQ)

# Documentation

See: https://docs.batch.sh/open-source/oss-connectors/kafka-sink-connector