https://github.com/neuw84/structured-streaming-avro-demo

Spark 3.0.0 Structured Streaming Kafka Avro Demo
https://github.com/neuw84/structured-streaming-avro-demo

java spark spark-streaming structured-streaming

Last synced: about 1 year ago
JSON representation

Spark 3.0.0 Structured Streaming Kafka Avro Demo

• Host: GitHub
• URL: https://github.com/neuw84/structured-streaming-avro-demo
• Owner: Neuw84
• License: bsd-3-clause
• Created: 2017-07-13T11:23:20.000Z (almost 9 years ago)
• Default Branch: master
• Last Pushed: 2023-04-21T20:44:14.000Z (about 3 years ago)
• Last Synced: 2023-08-09T07:31:18.199Z (almost 3 years ago)
• Topics: java, spark, spark-streaming, structured-streaming
• Language: Java
• Homepage:
• Size: 17.6 KB
• Stars: 16
• Watchers: 4
• Forks: 16
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# structured-streaming-avro-demo

Spark 3.0.0 Structured Streaming Kafka Avro demo using the new Avro Datasource. 

## Requirements 

* Kafka: 2.0

* Java 8

* Maven

## Usage

Configure kafka hosts and execute both the ```GeneratorDemo``` and the ```StructuredDemo``` classes.