https://github.com/dmathieu/kafka-connect-opensearch
Kafka Connect plugin for sending events to OpenSearch
https://github.com/dmathieu/kafka-connect-opensearch
kafka kafka-connect kafka-connector opensearch
Last synced: 3 months ago
JSON representation
Kafka Connect plugin for sending events to OpenSearch
- Host: GitHub
- URL: https://github.com/dmathieu/kafka-connect-opensearch
- Owner: dmathieu
- License: other
- Archived: true
- Created: 2021-10-14T09:30:15.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2022-05-30T16:24:39.000Z (about 4 years ago)
- Last Synced: 2023-03-10T21:17:29.071Z (over 3 years ago)
- Topics: kafka, kafka-connect, kafka-connector, opensearch
- Language: Java
- Homepage:
- Size: 229 KB
- Stars: 17
- Watchers: 5
- Forks: 5
- Open Issues: 6
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-kafka-connect - dmathieu/kafka-connect-opensearch - Community OpenSearch connector (Search Engines / OpenSearch)
README
# Kafka Connect OpenSearch Connector
**DEPRECATED**: This repoitory is deprecated. Please use [the aiven one](https://github.com/aiven/opensearch-connector-for-apache-kafka) instead.
kafka-connect-opensearch is a fork of Confluent's [kafka-connect-elasticsearch](https://github.com/confluentinc/kafka-connect-elasticsearch).
It allows runnig a [Kafka Connector](http://kafka.apache.org/documentation.html#connect) for copying data between Kafka and OpenSearch.
# Usage
## Installation
Each release publishes a JAR of the package which can be downloaded and used directly.
```
KAFKA_CONNECT_OPENSEARCH_VERSION=0.0.2
curl -L -o /tmp/kafka-connect-opensearch.jar https://github.com/dmathieu/kafka-connect-opensearch/releases/download/${KAFKA_CONNECT_OPENSEARCH_VERSION}/kafka-connect-opensearch.jar
```
Once you have the JAR file, move it to a path recognised by Java, such as `/usr/share/java/`.
## Configuration
Once the JAR is installed, you can configure a connector using it. Create your connector using the `com.dmathieu.kafka.opensearch.OpenSearchSinkConnector` class.
```
{
[...]
"connector.class": "com.dmathieu.kafka.opensearch.OpenSearchSinkConnector",
[...]
}
```
# About the license
Everything coming from the Confluent fork is licensed under the [Confluent Community License](LICENSE).
Everything that has changed from the Elasticsearch version is licensed under the MIT license.