Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with shaply
A curated list of projects in awesome lists tagged with shaply .
https://github.com/mervat-khaled/etl-apache-spark-nyc-taxi-data
The goal of this project is to do some ETL (Extract, Transform, and Load) In NYC Taxi Data and its geographical information Using Apache Spark, performing various transformations using Spark's python API "PySpark" and SQL language. And finally saving the processed data into CSVs file partitioned by the number of executors on spark session.
apache-spark docker-image etl geojson pyspark shaply spark-sql windowfunction
Last synced: 26 Nov 2024
