https://github.com/afranzi/mini-data-platform

Mini Data Platform
https://github.com/afranzi/mini-data-platform

airflow data-platform kubernetes minikube terraform

Last synced: 12 months ago
JSON representation

Mini Data Platform

• Host: GitHub
• URL: https://github.com/afranzi/mini-data-platform
• Owner: afranzi
• License: apache-2.0
• Created: 2024-02-26T09:05:48.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-03-04T18:08:06.000Z (about 2 years ago)
• Last Synced: 2025-03-27T01:47:50.564Z (about 1 year ago)
• Topics: airflow, data-platform, kubernetes, minikube, terraform
• Language: HCL
• Homepage: https://afranzi.github.io/mini-data-platform/
• Size: 1.07 MB
• Stars: 7
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# The Mini Data Platform

In the evolving landscape of data management and infrastructure automation, the ability to efficiently deploy and manage

data platforms is essential for any organization looking to leverage data-driven insights.

The mini data platform cluster project that embodies the spirit of innovation and learning in the fields of

Infrastructure as Code (IaC), Data Engineering, and Operations (Ops).

![Mini-DataPlatformConcept](docs/images/concept.jpg)

At the heart of this project lies a carefully curated stack comprising Terraform, Minikube, ArgoCD, and Airflow.

Each tool has been selected for its strength in automating and managing infrastructure, orchestrating deployments, and

scheduling complex workflows, respectively. Together, they form a robust framework that enables users to deploy a

miniature yet fully-functional data platform cluster with ease.

See full documentation in: [mini-data-platform docs](https://afranzi.github.io/mini-data-platform).