{"id":13459564,"url":"https://github.com/getindata/kedro-airflow-k8s","last_synced_at":"2025-04-09T20:11:42.453Z","repository":{"id":40407863,"uuid":"333367683","full_name":"getindata/kedro-airflow-k8s","owner":"getindata","description":"Kedro Plugin to support running pipelines on Kubernetes using Airflow.","archived":false,"fork":false,"pushed_at":"2025-03-11T17:00:11.000Z","size":319,"stargazers_count":28,"open_issues_count":19,"forks_count":11,"subscribers_count":11,"default_branch":"develop","last_synced_at":"2025-04-09T20:11:36.763Z","etag":null,"topics":["airflow","k8s","kedro","kedro-airflow","kedro-plugin","kuberentes","machinelearning","mlops"],"latest_commit_sha":null,"homepage":"https://kedro-airflow-k8s.readthedocs.io","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/getindata.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-01-27T09:26:27.000Z","updated_at":"2025-03-11T17:00:15.000Z","dependencies_parsed_at":"2024-07-21T00:53:04.943Z","dependency_job_id":"10fcf81e-e017-40cb-80db-b8f9cf013143","html_url":"https://github.com/getindata/kedro-airflow-k8s","commit_stats":null,"previous_names":[],"tags_count":29,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getindata%2Fkedro-airflow-k8s","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getindata%2Fkedro-airflow-k8s/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getindata%2Fkedro-airflow-k8s/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/getindata%2Fkedro-airflow-k8s/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/getindata","download_url":"https://codeload.github.com/getindata/kedro-airflow-k8s/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248103872,"owners_count":21048245,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["airflow","k8s","kedro","kedro-airflow","kedro-plugin","kuberentes","machinelearning","mlops"],"created_at":"2024-07-31T10:00:19.711Z","updated_at":"2025-04-09T20:11:42.443Z","avatar_url":"https://github.com/getindata.png","language":"Python","funding_links":[],"categories":["[Kedro plugins](https://docs.kedro.org/en/stable/extend_kedro/plugins.html)"],"sub_categories":[],"readme":"# :bangbang: DEPRECATION NOTICE :bangbang:\nThis plugin is no longer maintained. Use [kedro-airflow](https://pypi.org/project/kedro-airflow/) instead. \n\n\n# Kedro Airflow K8S Plugin\n\n[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8-blue.svg)](https://github.com/getindata/kedro-airflow-k8s)\n[![License](https://img.shields.io/badge/license-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0) \n[![SemVer](https://img.shields.io/badge/semver-2.0.0-green)](https://semver.org/)\n[![PyPI version](https://badge.fury.io/py/kedro-airflow-k8s.svg)](https://pypi.org/project/kedro-airflow-k8s/)\n[![Downloads](https://img.shields.io/pypi/dm/kedro-airflow-k8s)](https://img.shields.io/pypi/dm/kedro-airflow-k8s) \n\n[![Maintainability](https://api.codeclimate.com/v1/badges/f2ef65a9be497267c738/maintainability)](https://codeclimate.com/github/getindata/kedro-airflow-k8s/maintainability)\n[![Test Coverage](https://api.codeclimate.com/v1/badges/f2ef65a9be497267c738/test_coverage)](https://codeclimate.com/github/getindata/kedro-airflow-k8s/test_coverage)\n[![Documentation Status](https://readthedocs.org/projects/kedro-airflow-k8s/badge/?version=latest)](https://kedro-airflow-k8s.readthedocs.io/en/latest/?badge=latest)\n\n## About\n\nThe main purpose of this plugin is to enable running kedro pipeline with Airflow on Kubernetes Cluster. In difference to \n[kedro-airflow](https://github.com/quantumblacklabs/kedro-airflow) this plugin does not require additional libraries installed\nin airflow runtime, it uses K8S infrastructure instead. It supports translation\nfrom Kedro pipeline DSL to [airflow](https://airflow.apache.org/docs/apache-airflow/stable/python-api-ref.html) (python API)\nand generation of airflow [DAGs](https://airflow.apache.org/docs/apache-airflow/stable/concepts.html#dags).\n\nThe plugin can be used together with `kedro-docker` to simplify preparation of docker image for pipeline execution.   \n\n## Documentation\n\nFor detailed documentation refer to https://kedro-airflow-k8s.readthedocs.io/\n\n## Usage guide\n\n```\nUsage: kedro airflow-k8s [OPTIONS] COMMAND [ARGS]...\n \nOptions:\n  -e, --env TEXT  Environment to use.\n  -p, --pipeline TEXT  Pipeline name to pick.\n  -h, --help      Show this message and exit.\n\nCommands:\n  compile          Create an Airflow DAG for a project\n  init             Initializes configuration for the plugin\n  list-pipelines   List pipelines generated by this plugin\n  run-once         Uploads pipeline to Airflow and runs once\n  schedule         Uploads pipeline to Airflow with given schedule\n  ui               Open Apache Airflow UI in new browser tab\n  upload-pipeline  Uploads pipeline to Airflow DAG location\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgetindata%2Fkedro-airflow-k8s","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgetindata%2Fkedro-airflow-k8s","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgetindata%2Fkedro-airflow-k8s/lists"}