{"id":26091497,"url":"https://github.com/zeropsio/recipe-airflow","last_synced_at":"2026-03-01T12:35:12.648Z","repository":{"id":251375024,"uuid":"837222754","full_name":"zeropsio/recipe-airflow","owner":"zeropsio","description":"Apache Airflow on Zerops.","archived":false,"fork":false,"pushed_at":"2025-03-18T12:58:11.000Z","size":230,"stargazers_count":2,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-12-23T05:50:33.472Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zeropsio.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-08-02T13:26:01.000Z","updated_at":"2025-03-18T12:13:20.000Z","dependencies_parsed_at":null,"dependency_job_id":"901a806b-66cd-4061-9709-c367e2c9ac68","html_url":"https://github.com/zeropsio/recipe-airflow","commit_stats":null,"previous_names":["zeropsio/cheap-data-platform","zeropsio/recipe-airflow"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/zeropsio/recipe-airflow","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeropsio%2Frecipe-airflow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeropsio%2Frecipe-airflow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeropsio%2Frecipe-airflow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeropsio%2Frecipe-airflow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zeropsio","download_url":"https://codeload.github.com/zeropsio/recipe-airflow/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zeropsio%2Frecipe-airflow/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29969251,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-01T11:43:06.159Z","status":"ssl_error","status_checked_at":"2026-03-01T11:43:03.887Z","response_time":124,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-09T10:21:22.874Z","updated_at":"2026-03-01T12:35:07.639Z","avatar_url":"https://github.com/zeropsio.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Zerops x Apache Airflow\n\n[Apache Airflow](https://airflow.apache.org/) is an open-source platform for orchestrating and scheduling complex data pipelines. It allows you to programmatically author, schedule, and monitor workflows as Directed Acyclic Graphs (DAGs).\n\n![airflow](https://github.com/zeropsio/recipe-shared-assets/blob/main/covers/svg/cover-airflow.svg)\n\n\u003cbr /\u003e\n\n\n## Deploy on Zerops\nManually copy the [import yaml](https://github.com/zeropsio/recipe-airflow/blob/main/zerops-project-import.yml) to the import dialog in the Zerops app.\n\n```yaml\nproject:\n  name: Apache Airflow Standalone\n  tags:\n    - zerops-recipe\n    - development\nservices:\n  - hostname: airflowstandalone\n    type: python@3.12\n    verticalAutoscaling:\n      minRam: 1\n    maxContainers: 1\n    buildFromGit: https://github.com/zeropsio/recipe-airflow\n    enableSubdomainAccess: true\n```\n\nFor production-ready, high-available setup use [production import yaml](https://github.com/zeropsio/recipe-airflow/blob/main/zerops-project-production-import.yml).\n\n# Recipe Features\n- Apache Airflow version `2.10`\n- Python version `3.12`\n- Showcase DAG file\n\n## Development (Standalone)\n- Standalone mode ([docs](https://airflow.apache.org/docs/apache-airflow/stable/start.html)), not recommended for production usage\n- Access details can be found in runtime log, look for logs as the following:\n```text\nstandalone | Airflow is ready\nstandalone | Login with username: admin  password: *****\nstandalone | Airflow Standalone is for development purposes only. Do not use this in production!\n```\n\n## Production\n\n\u003e [!WARNING]  \n- Data are stored in Postgres\n- Celery executor (running on redis)\n- DAG files are distributed via shared storage (shared mounted volume)\n- Only push to the `airflowdags` service to update your DAG files (either via `zcli push airflowdags` or connect your Git with the `airflowdags` service), other services will use the files located in the mounted volume\n- UI access:\n  - Username: `admin`\n  - Password: `$ADMIN_PASSWORD` generated project environment variable (visible in GUI)\n\n### Ways To Reduce Cost\n- Change worker count\n- Decrease scaling resources to minimum\n- Change database services mode to `NON_HA` (historical data can be lost)\n\n# Running Your Own DAGs\nTo use your own data pipelines, simply:\n1. Fork this repository\n2. Deploy the project (or the individual services to an existing project) to Zerops\n3. Replace the insides of `dags` folder with your own pipelines\n4. Push to `airflowdags` service via zCLI or connect the `airflowdags` with the forked repository\n\n\u003cbr/\u003e\n\u003cbr/\u003e\n\nNeed help setting your project up? Join [Zerops Discord community](https://discord.com/invite/WDvCZ54).","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzeropsio%2Frecipe-airflow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzeropsio%2Frecipe-airflow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzeropsio%2Frecipe-airflow/lists"}