https://github.com/marcusrehm/airflow-dev-env
A simple container to run Apache Airflow on Windows machines.
https://github.com/marcusrehm/airflow-dev-env
airflow apache-airflow docker windows
Last synced: about 1 year ago
JSON representation
A simple container to run Apache Airflow on Windows machines.
- Host: GitHub
- URL: https://github.com/marcusrehm/airflow-dev-env
- Owner: marcusrehm
- Created: 2017-10-19T01:11:36.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2018-10-27T23:38:11.000Z (over 7 years ago)
- Last Synced: 2025-03-26T13:05:36.281Z (over 1 year ago)
- Topics: airflow, apache-airflow, docker, windows
- Language: Dockerfile
- Homepage:
- Size: 21.5 KB
- Stars: 4
- Watchers: 4
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Apache Airflow develop environment
#### A simple container to run Apache Airflow on Windows machines.
The main goal is create a minimal setup where Airflow can be hosted on Windows machines. This docker image has Airflow 1.9 installed using `pip install apache-airflow[crypto,postgres,hive,jdbc]` and running with SequentialExecutor and `SQLite` as backend.
Besides that oracle instant client 11g is also installed.
Tested on Windows 7, Windows 10 and Ubuntu 14.02 LTS.
This project is based on [docker-airflow](https://github.com/puckel/docker-airflow) image which is a great work.
# Getting Started
The image has four volumes:
- `usr/local/airflow/lib`: Should be mapped to the directory in your host machine where are the modules you use in dags are located.
- `usr/local/airflow/plugins`: Should be mapped to the plugins directory in your host machine.
- `usr/local/airflow/dags`: Should be mapped to the dags directory in your host machine.
- `usr/local/airflow/db`: Used to store `SQLite` database. If you need to remove the container or rebuild image, data (variable, connections, etc) used to develop and test is saved.
- Fernet Key can be configured in `.env` file. If it not exits a new key will be created.
If you are running it on Ubuntu you'll need to give write access to docker group to folders in your local machine where you mapped volumes above.
# Build and Test
```
docker build --rm -t marcusrehm/airflow-dev-env .
```
# Contribute
Feel free to fork, improve and PR.