https://github.com/biglocalnews/prefect-flow-template
A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.
https://github.com/biglocalnews/prefect-flow-template
data-journalism etl etl-pipeline pipeline prefect python task-runner
Last synced: 11 months ago
JSON representation
A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.
- Host: GitHub
- URL: https://github.com/biglocalnews/prefect-flow-template
- Owner: biglocalnews
- License: apache-2.0
- Created: 2022-03-28T17:40:01.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2022-03-29T19:42:25.000Z (over 4 years ago)
- Last Synced: 2025-04-30T18:02:48.769Z (about 1 year ago)
- Topics: data-journalism, etl, etl-pipeline, pipeline, prefect, python, task-runner
- Language: Python
- Homepage: https://github.com/biglocalnews/prefect-flow-template/wiki
- Size: 3.74 MB
- Stars: 20
- Watchers: 7
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
A [template repository](https://docs.github.com/en/repositories/creating-and-managing-repositories/creating-a-repository-from-a-template) with all the fundamentals needed to develop and deploy a Python data-processing routine for [Prefect](prefect.io) pipelines.
## Documentation
Learn how the system works — and how you can install it yourself — in the user manual at [github.com/biglocalnews/prefect-flow-template/wiki](https://github.com/biglocalnews/prefect-flow-template/wiki). It includes instructions on:
* [How it works](https://github.com/biglocalnews/prefect-flow-template/wiki)
* [Getting Started](https://github.com/biglocalnews/prefect-flow-template/wiki/1.-Getting-Started)
* [Google Cloud Deployment Configuration](https://github.com/biglocalnews/prefect-flow-template/wiki/2.-Google-Cloud-Deployment-Configuration)
* [Releasing updates](https://github.com/biglocalnews/prefect-flow-template/wiki/3.-Releasing-updates)
## About
The project is sponsored by [Big Local News](https://biglocalnews.org/#/about), a program at Stanford University that collects data for impactful journalism. The code is maintained by [Ben Welsh](https://palewi.re/who-is-ben-welsh/), a visiting data journalist from the Los Angeles Times.