https://github.com/xnuinside/smartdata_2022
Files for SmartData 2022 Talk
https://github.com/xnuinside/smartdata_2022
Last synced: 10 months ago
JSON representation
Files for SmartData 2022 Talk
- Host: GitHub
- URL: https://github.com/xnuinside/smartdata_2022
- Owner: xnuinside
- Created: 2022-09-20T08:40:02.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2022-10-29T05:18:02.000Z (over 3 years ago)
- Last Synced: 2025-04-06T16:18:08.384Z (about 1 year ago)
- Language: Python
- Size: 11.7 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# smartdata_2022
In this talk I explain why it is totally wrong to compare Prefect vs Apache Airflow & why no sense to try do same pipelines as on Apache Airflow in Prefect.
So main_flow.py is a bad example by idea. Code is correct & it is working, but it is a bad example of Prefect Usage.
### Up & Run prefect cluster
Already with Agent & DB.
```bash
docker-compose -f docker-compose-prefect.yml up --build
```
### Login into Prefect UI
go to http://localhost:4200
### Deploy flow
Create deployment build
```console
prefect deployment build prefect_flows/main_flow_empty.py:db_data_process_flow --name first
```
Apply build
```console
prefect deployment apply db_data_process_flow-deployment.yaml
```
### Prefect run from console
Run server
```
prefect orion start
```
Run agent
```
prefect agent start default
```