https://github.com/abrahamkoloboe27/random-user-streaming-pipeline

Data Engeenering Project - Data Pipeline
https://github.com/abrahamkoloboe27/random-user-streaming-pipeline

airflow airflow-dags api docker docker-compose etl etl-pipeline extract-transform-load kafka kafka-consumer kafka-producer makefile orchestration postgresql python schema-registry spark spark-streaming zookeeper

Last synced: 21 days ago
JSON representation

Data Engeenering Project - Data Pipeline

• Host: GitHub
• URL: https://github.com/abrahamkoloboe27/random-user-streaming-pipeline
• Owner: abrahamkoloboe27
• Created: 2024-10-04T09:44:53.000Z (5 months ago)
• Default Branch: main
• Last Pushed: 2024-12-07T12:15:06.000Z (3 months ago)
• Last Synced: 2025-01-30T20:54:16.248Z (21 days ago)
• Topics: airflow, airflow-dags, api, docker, docker-compose, etl, etl-pipeline, extract-transform-load, kafka, kafka-consumer, kafka-producer, makefile, orchestration, postgresql, python, schema-registry, spark, spark-streaming, zookeeper
• Language: Jupyter Notebook
• Homepage:
• Size: 128 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:

Awesome Lists containing this project