https://github.com/lsjsj92/airflow_tutorial

python airflow tutorial and example
https://github.com/lsjsj92/airflow_tutorial

airflow apache apache-airflow example machine-learning machinelearning mlops python tutorial

Last synced: 18 days ago
JSON representation

python airflow tutorial and example

• Host: GitHub
• URL: https://github.com/lsjsj92/airflow_tutorial
• Owner: lsjsj92
• Created: 2022-02-04T06:10:39.000Z (about 4 years ago)
• Default Branch: main
• Last Pushed: 2022-03-23T06:04:17.000Z (about 4 years ago)
• Last Synced: 2025-08-01T13:55:38.523Z (8 months ago)
• Topics: airflow, apache, apache-airflow, example, machine-learning, machinelearning, mlops, python, tutorial
• Language: Python
• Homepage:
• Size: 11.7 KB
• Stars: 12
• Watchers: 1
• Forks: 6
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# airflow_tutorial

**airflow python tutorial & example**

해당 repo는 블로그에 기술해 놓은 내용에 사용된 airflow example 코드입니다.

**blog**

- https://lsjsj92.tistory.com/

----

## Dags dir

- example_basic_dag.py

    - Basic example DAG

    - Same as airflow doc : https://airflow.apache.org/docs/apache-airflow/stable/tutorial.html

    - Blog description : https://lsjsj92.tistory.com/631

- example_sequence_dag.py

    - Sequence DAG example ( dag branch )

    - Blog description : https://lsjsj92.tistory.com/632

- example_python_dag.py

    - Python basic DAG example

    - Blog description : https://lsjsj92.tistory.com/632

- example_ml_dag.py

    - Machine Learning basic DAG example

    - Run with MLproject dir

    - Titanic data & scikit-learn

    - Blog description : https://lsjsj92.tistory.com/633

- example_slack_dag.py

    - Airflow slack alert example

    - Basically the same as example_ml_dag.py code and added slack api

    - Blog description : https://lsjsj92.tistory.com/634

---- 

## Repository file structure

```

airflow_tutorial

│   README.md

│   .gitignore    

│

└───dags

│   │   example_basic_dag.py

│   │   example_sequence_dag.py

│   │   example_python_dag.py

│   │   example_ml_dag.py

│   │   example_slack_dag.py

└───MLproject

│   │   config.py

│   │   dataio.py

│   │   model.py

│   │   preprocess.py

│   │   titanic.py

│   └───data

│   └─────titanic

│   │     │   train.csv

│   │     │   prepro_titanic.csv

└───utils

│   │   slack_alert.py

```