https://github.com/rellyson/data-engineering-tools

This repository holds examples and documentation about the most used tools in the data engineering ecosystem.
https://github.com/rellyson/data-engineering-tools

apache-airflow apache-spark data data-engineering jupyter-notebook python tools

Last synced: 5 months ago
JSON representation

This repository holds examples and documentation about the most used tools in the data engineering ecosystem.

• Host: GitHub
• URL: https://github.com/rellyson/data-engineering-tools
• Owner: rellyson
• License: mit
• Created: 2024-02-13T14:21:32.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-02-13T15:32:36.000Z (over 2 years ago)
• Last Synced: 2024-02-13T16:41:17.042Z (over 2 years ago)
• Topics: apache-airflow, apache-spark, data, data-engineering, jupyter-notebook, python, tools
• Language: Dockerfile
• Homepage:
• Size: 110 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          


  

  
Exploring Data Engineering tools


  [![License](https://img.shields.io/badge/License-MIT-b5dc10)](https://opensource.org/licenses/MIT)

  ![airflow](https://img.shields.io/badge/Apache%20Airflow-2.8.1-blue?logo=apacheairflow)

  ![spark](https://img.shields.io/badge/Apache%20Spark-3.5.0-orange?logo=apachespark)



## About

This repository holds examples and documentation

about the most used tools in the data engineering ecosystem.

## Running

This project contains `docker compose` files

which you can use to start some tool stack (ex: Spark using the `docker-compose-spark.yaml` file).