{"id":15801935,"url":"https://github.com/mrecco/kubernetes-airflow-ide","last_synced_at":"2025-05-07T17:52:03.984Z","repository":{"id":195178033,"uuid":"306955259","full_name":"MrEcco/kubernetes-airflow-ide","owner":"MrEcco","description":"Apache Airflow IDE with Kubernetes Operator capabilities","archived":false,"fork":false,"pushed_at":"2020-10-24T19:25:23.000Z","size":10,"stargazers_count":5,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-05-07T17:51:53.720Z","etag":null,"topics":["airflow","docker","docker-compose","ide","kubernetes"],"latest_commit_sha":null,"homepage":"","language":"Dockerfile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/MrEcco.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2020-10-24T19:21:11.000Z","updated_at":"2024-12-05T14:13:00.000Z","dependencies_parsed_at":"2023-09-16T21:42:07.876Z","dependency_job_id":"5b3b0e59-ed9c-44e8-b2c7-a1cd9926d74d","html_url":"https://github.com/MrEcco/kubernetes-airflow-ide","commit_stats":null,"previous_names":["mrecco/kubernetes-airflow-ide"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MrEcco%2Fkubernetes-airflow-ide","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MrEcco%2Fkubernetes-airflow-ide/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MrEcco%2Fkubernetes-airflow-ide/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MrEcco%2Fkubernetes-airflow-ide/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/MrEcco","download_url":"https://codeload.github.com/MrEcco/kubernetes-airflow-ide/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252931391,"owners_count":21827104,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["airflow","docker","docker-compose","ide","kubernetes"],"created_at":"2024-10-05T01:41:25.629Z","updated_at":"2025-05-07T17:52:03.962Z","avatar_url":"https://github.com/MrEcco.png","language":"Dockerfile","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Apache Airflow IDE\n\nApache Airflow IDE with Kubernetes Operator capabilities.\n\nKubernetes can be painful for any untrained specialist. This is preconfigured local\ndevelopment environment with full power of Kubernetes Operator, but with whole\nbootstrapment automations. This repository just provide easy way to use Apache Airflow\nand real Kubernetes cluster on the local. Dont use it in production! Deployment ready\nto use by analists with python stack which have no any understanding about kubernetes :)\n\n## Meet the Airflow\n\nThis is easy to welcome and almost full description about capabilities provided\nby Airflow. Recommended to read before any action.\n\nhttps://airflow.apache.org/docs/stable/concepts.html\n\n## IDE\n\nThis is local bootstrapment of Apache Airflow service! It have fully-featured service\nwith API, web UI, scheduler, database server (required for service components), small\nkubernetes cluster and some helpers which automate cluster routines.\n\nComponents:\n\n- Web interface. Doesnt handle AAA-features, mean have no authorization.\n\n- Scheduler. Defaulted to spawn workloads to kubernetes.\n\n- Kubernetes. Simplified version, but fully-featured. Based on kubernetes-in-docker\n(see [kind project](https://kind.sigs.k8s.io/)) tehnique (but all wrapped by docker-in-docker).\n\n- Docker registry. Helps to use local builded airflow image to kubernetes-accessible\nplace.\n\n## How to use\n\nAll what you need in Makefile. And you must neet to install Makefile resolver:\n`brew install make` on MacOS or `apt-get install make || yum install make`\non Linux. This is required single time only. Actualy, this works on Windows, but\nthis manual doesnt cover how to install `make` into Windows.\n\nFor start your system, run this:\n\n```bash\nmake start\n```\n\nAfter few-five minutes your system is ready to use: see `http://127.0.0.1:8080`\nfor Apache Airflow web interface. If you need, you can look for kubernetes\nweb interface: `http://127.0.0.1:8008`.\n\nYou can rebuild images for add supported packages to Apache Airflow. Just add\nrequired libs to `docker/airflow/requirements.txt` file and start building\nprocess:\n\n```bash\n# add libs to docker/airflow/requirements.txt\nmake rebuild\nmake restart\n```\n\nFor stop (and release used resources), run this:\n\n```bash\nmake stop\n```\n\n## Links\n\nAirflow Docs: https://airflow.apache.org/docs\n\nKubernetes API Reference: https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.19/\n\n## License\n\nLicensed by MIT.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmrecco%2Fkubernetes-airflow-ide","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmrecco%2Fkubernetes-airflow-ide","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmrecco%2Fkubernetes-airflow-ide/lists"}