https://github.com/flix-tech/k8s-airflow
run airflow on kubernetes for historical processing
https://github.com/flix-tech/k8s-airflow
Last synced: over 1 year ago
JSON representation
run airflow on kubernetes for historical processing
- Host: GitHub
- URL: https://github.com/flix-tech/k8s-airflow
- Owner: flix-tech
- Created: 2019-12-03T16:49:39.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2020-10-19T21:39:42.000Z (almost 6 years ago)
- Last Synced: 2025-02-14T04:51:13.401Z (over 1 year ago)
- Language: Python
- Size: 54.7 KB
- Stars: 0
- Watchers: 7
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Aiflow on Kubernetes
This is a project to a airflow app on Kubernetes. More information [here](https://airflow.apache.org/kubernetes.html).
## run app locally
Install local Kubernetes cluster first. Use [minikube](https://kubernetes.io/docs/tasks/tools/install-minikube/).
Install `task` build tools [task](https://taskfile.dev/#/installation).
Run locally:
```shell script
task run.local
```
Undeploy locally:
```shell script
task airflow.undeploy
```
## deploy on EKS Kubernetes cluster
First you need to deploy manually the service account and rolebindings:
```shell script
#First login into your k8s namespace
kubectl -n $NAMESPACE apply -f k8s/rolebinding.yaml
```