https://github.com/khorshuheng/kafka-protobuf-console

CLI tool to produce/consume Protobuf message to/from Kafka
https://github.com/khorshuheng/kafka-protobuf-console

kafka-consumer kafka-producer kafka-protobuf-console protobuf

Last synced: about 2 months ago
JSON representation

CLI tool to produce/consume Protobuf message to/from Kafka

• Host: GitHub
• URL: https://github.com/khorshuheng/kafka-protobuf-console
• Owner: khorshuheng
• Created: 2019-08-25T03:58:00.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2019-09-09T05:07:50.000Z (over 5 years ago)
• Last Synced: 2024-06-20T09:20:51.718Z (7 months ago)
• Topics: kafka-consumer, kafka-producer, kafka-protobuf-console, protobuf
• Language: Go
• Homepage:
• Size: 25.4 KB
• Stars: 14
• Watchers: 2
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Kafka Protobuf Console

Kafka Protobuf Console is a CLI which provides the following functionalities:

* Produce protobuf message to Kafka using Json input

* Consume protobuf message from Kafka and displayed the message in Json format

* Produce protobuf messages continuously to Kafka with random field values (WIP)

## Installation

### From source

1. Clone the repository.

2. The Golang version installed should be higher than v1.11.

2. Run ```make install```.

### Compiled binary

WIP

## Quick Start

Example scripts can be found within the ```examples``` directory. For convenience, a docker compose file has also been included so that the user can try using the console with minimal set up.

## Kafka Protobuf Console Producer

### Usage

```go

Usage:

  kafka-protobuf-console produce [flags]

Flags:

  -b, --brokers strings     Comma separated Kafka brokers address

  -d, --descriptor string   File descriptor path

  -h, --help                help for produce

  -n, --name string         Fully qualified Proto message name

  -t, --topic string        Destination Kafka topic

```

## Kafka Protobuf Console Consumer

### Usage

```go

Consume Protobuf message from Kafka

Usage:

  kafka-protobuf-console consume [flags]

Flags:

  -b, --brokers strings     Comma separated Kafka brokers address

  -d, --descriptor string   File descriptor path

  -f, --from-beginning      Consume from beginning

  -n, --name string         Fully qualified Proto message name

  -p, --pretty              Pretty print json output (default true)

  -t, --topic string        Destination Kafka topic

  -v, --version string      Kafka version (eg. 2.0.0)

```