https://github.com/vubacktracking/fr_de_batch11_03_vupdh_week2
https://github.com/vubacktracking/fr_de_batch11_03_vupdh_week2
Last synced: over 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/vubacktracking/fr_de_batch11_03_vupdh_week2
- Owner: VuBacktracking
- Created: 2024-11-25T08:36:13.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-11-25T09:15:59.000Z (over 1 year ago)
- Last Synced: 2025-01-31T09:44:54.148Z (over 1 year ago)
- Language: Python
- Size: 1.09 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
### **Simple ETL Pipeline Using Apache Airflow and Minio**
This guide provides steps to set up and run a simple ETL pipeline using Apache Airflow with Docker Compose and Minio integration.
**Prerequisites**
- Docker and Docker Compose: Make sure Docker and Docker Compose are installed on your system.
- Minio Credentials: Have access to your Minio Access Key and Secret Key.
- .env File: Configure the .env file with your AWS credentials and any other required environment variables.