Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/andreax79/airflow-code-editor
A plugin for Apache Airflow that allows you to edit DAGs in browser
airflow airflow-plugin apache-airflow python
Last synced: 15 Jun 2024
https://github.com/ajbosco/dag-factory
Dynamically generate Apache Airflow DAGs from YAML configuration files
airflow apache-airflow dags python
Last synced: 15 Jun 2024
https://github.com/teamclairvoyant/airflow-maintenance-dags
A series of DAGs/Workflows to help maintain the operation of Airflow
airflow airflow-maintenance-dags apache-airflow cleanup dag maintenance workflow
Last synced: 15 Jun 2024
https://github.com/michaelosthege/fairflow
Functional Airflow DAG definitions.
Last synced: 15 Jun 2024
https://github.com/xnuinside/airflow-helper
Airflow Helper is a tool that currently allows setting up Airflow Variables, Connections, and Pools from a YAML configuration file. Support yaml inheritance & can obtain all settings from existed Airflow Server!
airflow airflow-toolkit airflow-tools apache-airflow cli command-line command-line-tool python
Last synced: 15 Jun 2024
https://github.com/astronomer/astronomer
Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
apache-airflow astronomer-platform astronomer-software docker kubernetes
Last synced: 15 Jun 2024
https://github.com/rolanddb/airflow-on-kubernetes
A guide to running Airflow on Kubernetes
Last synced: 15 Jun 2024
https://github.com/san089/goodreads_etl_pipeline
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
airflow airflow-dag apache-airflow apache-spark data-engineering data-engineering-pipeline data-lake data-migration emr-cluster etl-framework etl-job etl-pipeline goodreads-data-pipeline livy python redshift s3 scheduler spark warehouse
Last synced: 13 Jun 2024
https://github.com/jghoman/awesome-apache-airflow
Curated list of resources about Apache Airflow
airflow apache-airflow awesome awesome-list workflow-management
Last synced: 12 Jun 2024
https://github.com/timkpaine/paperboy
A web frontend for scheduling Jupyter notebook reports
airflow apache-airflow celery dask docker jupyter jupyter-notebook jupyter-notebooks jupyterlab kubernetes luigi notebook nteract papermill phosphorjs scheduling-notebooks
Last synced: 26 May 2024
https://github.com/GoogleCloudPlatform/airflow-operator
Kubernetes custom controller and CRDs to managing Airflow
airflow airflow-operator apache-airflow crd kubernetes kubernetes-controller kubernetes-operator workflow-engine
Last synced: 22 May 2024
https://github.com/teamclairvoyant/airflow-rest-api-plugin
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
airflow airflow-plugin airflow-webserver apache-airflow plugin rest-api
Last synced: 13 May 2024
https://github.com/couler-proj/couler
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
apache-airflow argo-workflows cloud-native distributed-computing kubeflow kubernetes machine-learning python scheduler tekton-pipelines unified-api unified-interface workflow-automation workflow-engine workflow-management
Last synced: 12 May 2024
https://github.com/elyra-ai/elyra
Elyra extends JupyterLab with an AI centric approach.
ai airflow anaconda apache-airflow binder docker elyra hacktoberfest jupyterlab jupyterlab-extension jupyterlab-extensions jupyterlab-notebooks kubeflow kubeflow-pipelines machine-learning notebook-jupyter notebooks pipelines pypi python
Last synced: 06 May 2024
https://github.com/apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
airflow apache apache-airflow automation dag data-engineering data-integration data-orchestrator data-pipelines data-science elt etl machine-learning mlops orchestration python scheduler workflow workflow-engine workflow-orchestration
Last synced: 26 Apr 2024
https://github.com/astronomer/astro-sdk
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
airflow apache-airflow bigquery dags data-analysis data-science elt etl gcs pandas postgres python s3 snowflake sql sqlite workflows
Last synced: 24 Mar 2024