Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

Projects in Awesome Lists tagged with parquet-storage

A curated list of projects in awesome lists tagged with parquet-storage .

https://github.com/lilivalgo/smartcity

Simulates a real-time Smart City data pipeline with Kafka, Apache Spark, and S3. Streams and processes vehicle, GPS, weather, traffic, and emergency data with Dockerized components and Parquet storage for efficient, scalable data engineering

apache-spark aws-s3 data-pipeline distributed-processing doker kafka parquet-storage real-time real-time-streaming

Last synced: 03 Nov 2024