https://github.com/san089/spark_packaged_project

This project contains pyspark jobs to create data pipelines and shows how to distribute the project package on Cluster.
https://github.com/san089/spark_packaged_project

data-pipeline etl etl-framework etl-pipeline job pyspark spark

Last synced: 3 months ago
JSON representation

This project contains pyspark jobs to create data pipelines and shows how to distribute the project package on Cluster.

• Host: GitHub
• URL: https://github.com/san089/spark_packaged_project
• Owner: san089
• License: gpl-3.0
• Created: 2019-02-02T00:05:25.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2019-07-28T01:00:21.000Z (over 5 years ago)
• Last Synced: 2024-10-13T00:06:38.320Z (4 months ago)
• Topics: data-pipeline, etl, etl-framework, etl-pipeline, job, pyspark, spark
• Language: Python
• Size: 515 KB
• Stars: 6
• Watchers: 2
• Forks: 4
• Open Issues: 0

Awesome Lists containing this project