https://github.com/juftin/airflow
Multi Container Airflow DAG Application
https://github.com/juftin/airflow
airflow dag docker-compose pipeline python3
Last synced: over 1 year ago
JSON representation
Multi Container Airflow DAG Application
- Host: GitHub
- URL: https://github.com/juftin/airflow
- Owner: juftin
- License: mit
- Created: 2020-09-04T19:39:10.000Z (almost 6 years ago)
- Default Branch: main
- Last Pushed: 2021-08-28T06:14:08.000Z (almost 5 years ago)
- Last Synced: 2025-01-23T14:17:04.995Z (over 1 year ago)
- Topics: airflow, dag, docker-compose, pipeline, python3
- Language: Python
- Homepage:
- Size: 28.3 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# airflow
[](https://hub.docker.com/u/juftin)
[](LICENSE.md)
This repository is some experimental work being performed on Airflow.
At the root of is the [airflow.yml](airflow.yml) file which is a
[docker-compose](https://docs.docker.com/compose/) configuration file.
Accompanying the [airflow.yml](airflow.yml) file, is the [.env](example.env) configuration
file which has a temporary placeholder, [example.env](example.env).
### Docker Compose
#### Services
- webserver
- [traefik:v2.2](https://hub.docker.com/_/traefik)
- airflow
- [puckel/docker-airflow:1.10.9](https://hub.docker.com/r/puckel/docker-airflow)
- airflow backend database
- [postgres:9.6](https://hub.docker.com/_/postgres)
### Startup
1) Clone or rename the [example.env](example.env) -> `.env`
```bash
cp example.env .env
```
2) Populate placeholder values, if any, on `.env`
3) Start the multi-container Docker application.
```bash
docker-compose up
```
4) Launch Airflow @ [http://airflow.localhost/](http://airflow.localhost/)
5) Optionally, monitor webserver @ [http://traefik.localhost/](http://traefik.localhost/)
Helpful Links:
- [Airflow Documentation](https://airflow.apache.org/docs/stable/)
- [Airflow Source Code](https://github.com/apache/airflow/)
- [Airflow Docker Image](https://hub.docker.com/r/puckel/docker-airflow)
###### Cool stuff happens in Denver, CO [
]()