Ecosyste.ms: Awesome

https://github.com/faizpuad/dataengineeringproject-documentstreamingwithdata

The core objective of this project is to build an end-to-end data streaming pipeline that processes this dataset in real-time. By leveraging modern data engineering tools and techniques, we aim to connect, buffer, process, store, and visualize streaming data. This allows for better understanding of data flows, handling of large-scale real-time data

data-engineering document-streaming fastapi kafka mon spark-streaming-kafka streamlit

Last synced: 18 Dec 2024