Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/stefen-taime/etl-data-pipeline-rdbms-to-hdfs-using-airflow-apache-sqoop-spark-postgres-and-hive

airflow big-data data docker-compose etl-pipeline hdfs hive infrastructure-as-code rdbms spark sql sqoop

Last synced: 23 days ago
JSON representation

This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)

Host: GitHub
URL: https://github.com/stefen-taime/etl-data-pipeline-rdbms-to-hdfs-using-airflow-apache-sqoop-spark-postgres-and-hive
Owner: Stefen-Taime
Created: 2022-04-29T13:48:01.000Z (almost 3 years ago)
Default Branch: main
Last Pushed: 2022-04-29T14:05:26.000Z (almost 3 years ago)
Last Synced: 2024-11-16T12:13:43.396Z (3 months ago)
Topics: airflow, big-data, data, docker-compose, etl-pipeline, hdfs, hive, infrastructure-as-code, rdbms, spark, sql, sqoop
Language: Python
Homepage:
Size: 17.7 MB
Stars: 10
Watchers: 1
Forks: 3
Open Issues: 0