https://github.com/martishin/kafka-spark-cassandra-processing-example

Kafka -> Spark -> Cassandra processing example
https://github.com/martishin/kafka-spark-cassandra-processing-example

airflow cassandra data-engineering docker kafka python spark

Last synced: 19 days ago
JSON representation

Kafka -> Spark -> Cassandra processing example

• Host: GitHub
• URL: https://github.com/martishin/kafka-spark-cassandra-processing-example
• Owner: martishin
• Created: 2024-08-25T20:52:20.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-08-28T08:34:11.000Z (5 months ago)
• Last Synced: 2024-11-16T09:33:56.481Z (3 months ago)
• Topics: airflow, cassandra, data-engineering, docker, kafka, python, spark
• Language: Python
• Homepage:
• Size: 14.6 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Kafka -> Spark -> Cassandra Processing Example

Run locally: `docker-compose up`

Tools: 

* Airflow UI: http://localhost:8080/home  

* Spark UI: http://localhost:9090