https://github.com/nryanov/avromirrormaker

AvroMirrorMaker allows you to replicate data from topics which use different schema registry provider
https://github.com/nryanov/avromirrormaker

avro confluent hortonworks java kafka mirrormaker schema-registry

Last synced: 16 days ago
JSON representation

AvroMirrorMaker allows you to replicate data from topics which use different schema registry provider

• Host: GitHub
• URL: https://github.com/nryanov/avromirrormaker
• Owner: nryanov
• License: apache-2.0
• Created: 2019-07-18T23:09:14.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2019-08-29T18:49:03.000Z (over 5 years ago)
• Last Synced: 2024-11-03T07:23:28.059Z (2 months ago)
• Topics: avro, confluent, hortonworks, java, kafka, mirrormaker, schema-registry
• Language: Java
• Homepage:
• Size: 185 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# AvroMirrorMaker

AvroMirrorMaker allows you to replicate data from topics which use different schema registry provider.

```text

Confluent schema registry -> Confluent schema registry

Horton schema registry -> Horton schema registry

Confluent schema registry -> Horton schema registry

Horton schema registry -> Confluent schema registry

```

## Requirments

 - Java 8

## Build

`gradle jar`

## Setup

Put `avro-mirror-maker-VERSION-all.jar` from `build/libs` to shared directory for kafka libs or add path to this jar:

```bash

export CLASSPATH=$CLASSPATH:

```

## Usage

```bash

./kafka-mirror-maker --consumer.config consumer.properties --producer.config producer.properties --message.handler avro.mirrormaker.ConfluentToHortonHandler --message.handler.args http://confluent:port,http://horton:port

./kafka-mirror-maker --consumer.config consumer.properties --producer.config producer.properties --message.handler avro.mirrormaker.HortonToConfluentHandler --message.handler.args http://horton:port,http://confluent:port

./kafka-mirror-maker --consumer.config consumer.properties --producer.config producer.properties --message.handler avro.mirrormaker.ConfluentToConfluentHandler --message.handler.args http://confluent1:port,http://confluent2:port

./kafka-mirror-maker --consumer.config consumer.properties --producer.config producer.properties --message.handler avro.mirrormaker.HortonToHortonHandler --message.handler.args http://horton1:port,http://horton2:port

```

## Tested versions

|AvroMirrorMaker       | Kafka   | 

|----------------|--------|

| 0.1 | 2.0.0 (Confluent 5.0.0)   |

| 0.2 | 2.1.0 (Confluent 5.1.0)   |

## License

Licensed under the **[Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0)** (the "License");

you may not use this software except in compliance with the License.

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License.