Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/akhich551995/data-streaming-project-airflow-kafka-spark-t-cassandra-docker
building a real-time data streaming pipeline, covering each phase from data ingestion to processing and finally storage. We'll utilize a powerful stack of tools and technologies, including Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra—all neatly containerized using Docker.
https://github.com/akhich551995/data-streaming-project-airflow-kafka-spark-t-cassandra-docker
airflow airflow-dags cassandra docker kafka postgresql python spark zookeeper
Last synced: 20 days ago
JSON representation
building a real-time data streaming pipeline, covering each phase from data ingestion to processing and finally storage. We'll utilize a powerful stack of tools and technologies, including Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra—all neatly containerized using Docker.
- Host: GitHub
- URL: https://github.com/akhich551995/data-streaming-project-airflow-kafka-spark-t-cassandra-docker
- Owner: akhich551995
- License: mit
- Created: 2024-01-29T22:00:37.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-01-30T19:18:26.000Z (about 1 year ago)
- Last Synced: 2025-01-21T02:09:06.861Z (20 days ago)
- Topics: airflow, airflow-dags, cassandra, docker, kafka, postgresql, python, spark, zookeeper
- Language: Python
- Homepage:
- Size: 1.95 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Data-streaming-project-airflow-Kafka-spark-t-cassandra-docker
building a real-time data streaming pipeline, covering each phase from data ingestion to processing and finally storage. We'll utilize a powerful stack of tools and technologies, including Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra—all neatly containerized using Docker.