https://github.com/polyseam/my-airflow-abc
https://github.com/polyseam/my-airflow-abc
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/polyseam/my-airflow-abc
- Owner: polyseam
- License: apache-2.0
- Created: 2024-02-16T00:10:03.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-05-06T10:53:07.000Z (about 2 years ago)
- Last Synced: 2025-07-23T09:31:52.435Z (11 months ago)
- Language: Dockerfile
- Size: 198 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
README
EZ AF Baking
for baking Airflow images with custom dependencies
## Usage
### Setup Repo
Click the
[Use this template](https://github.com/new?template_name=ez-af-baking&template_owner=polyseam)
button!
### Set Requirements
1. Pull down the repo
2. Add your dependencies to `requirements.txt`
### Push Code to GitHub
1. `git add .`
2. `git commit -m "added dependencies"`
3. `git push`
### Publish Image to the Container Registry
Automation will publish your image when you push a tag to the repo.
1. run `git tag v1.0.0` to designate an image version
2. run `git push --tags` to publish that version
3. the published images should be shown in the GitHub packages tab over there ↗️
### using the image in Airflow Kubernetes (optional)
Now that you have an image in the [GitHub Container Registry](https://ghcr.io),
you need to be able to consume it from Airflow.
- If you are using Polyseam's [CNDI](https://github.com/polyseam/cndi), here is
[an example here showing how to securely apply that secret for your Airflow Container Image](./docs/examples/cndi).
- There is also an
[example provided here](./docs/examples/plain/registry-secret.yaml) if you are
using Airflow on Kubernetes without CNDI.
In either case once you've applied the Secret you just need to tell Airflow to
use it in your Helm Chart's values:
```yaml
values:
registry:
secretName: airflow-image-pull-secret
images:
airflow:
repository: 'ghcr.io/johnstonmatt/my-baked-image'
tag: v1.0.0
```