https://github.com/ms32035/airflow-dag-dependencies

Visualize dependencies between Airflow DAGs
https://github.com/ms32035/airflow-dag-dependencies

airflow

Last synced: 2 months ago
JSON representation

Visualize dependencies between Airflow DAGs

• Host: GitHub
• URL: https://github.com/ms32035/airflow-dag-dependencies
• Owner: ms32035
• Created: 2019-08-22T21:25:30.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2021-05-07T20:33:30.000Z (over 3 years ago)
• Last Synced: 2024-08-03T02:07:09.847Z (5 months ago)
• Topics: airflow
• Language: HTML
• Homepage:
• Size: 62.5 KB
• Stars: 49
• Watchers: 6
• Forks: 7
• Open Issues: 0
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

• awesome-apache-airflow - Dag Dependencies viewer - A plugin which creates a view to visualize dependencies between the Airflow DAGs (Libraries, Hooks, Utilities)

README

        
# Airflow DAG Dependencies

**:warning: Deprecation notice :warning:**

The functionality of this plugin is now part of Airflow - https://github.com/apache/airflow/pull/13199

If you find any critical issues affecting Airflow 1.10.x, feel free

to sumbit a PR, but no new features will be added here.

## Functionality

* Visualize dependencies between your Airflow DAGs

* 3 types of dependencies supported:

  * Trigger - `TriggerDagRunOperator` in DAG A triggers DAG B

  * Sensor - `ExternalTaskSensor` in DAG A waits for (task in) DAG B

  * Implicit - provide the ids of DAGs the DAGs depends on as an attribute named `implicit_dependencies`.

  For example `dag.implicit_dependencies = ['dag_1', 'dag_2']`  

* Be careful if you have 1000s of DAGs, might not scale.

![](screenshot.png)

## Installation

Copy `dag-dependencies-plugin` to Airflow plugin folder and you're ready to go

Only RBAC UI is supported.