Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/igr/airfog

Airfog
https://github.com/igr/airfog

Last synced: 24 days ago
JSON representation

Airfog

Awesome Lists containing this project

README

        

# AirFog 🌁

Common [AirFlow](https://airflow.apache.org) tasks.

## Setup

Create `airfog.json`:

```json
{
"host": "airflow.k8s.foursquare.com",
"scheme": "https",
"username": "ispasic",
"password": "..."
}
```

## Usage

### `clear-ti` Clear Task Instances

+ Clears Task instances that are _not_ in the `success` state for given `dagID` and latest run.
+ Optionally, `dagRunID` may be used to specify the specific run.
+ Parent DAGs of failed task instances are cleared, too.
+ After the cleanup, the DagRun is re-started, so all cleared tasks will run again.

[Airflow API](https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/post_clear_task_instances)

```shell
airfog clear-ti --dag=shapes_biweekly_geocode_build
```

### `run-all-tag` Run all DAGs with given tag

+ Run all DAGs with given tag name.

```shell
airfog run-all-tag --tag ELMER
```