https://github.com/statcan/aaw-kubeflow-mlops
Kubeflow MLOps pipeline using GitHub Actions
https://github.com/statcan/aaw-kubeflow-mlops
aaw daaas kubeflow kubernetes mlops
Last synced: 2 months ago
JSON representation
Kubeflow MLOps pipeline using GitHub Actions
- Host: GitHub
- URL: https://github.com/statcan/aaw-kubeflow-mlops
- Owner: StatCan
- License: other
- Created: 2020-07-14T20:23:59.000Z (about 5 years ago)
- Default Branch: master
- Last Pushed: 2023-02-07T19:01:31.000Z (over 2 years ago)
- Last Synced: 2023-03-02T22:23:10.244Z (over 2 years ago)
- Topics: aaw, daaas, kubeflow, kubernetes, mlops
- Language: Python
- Homepage:
- Size: 760 KB
- Stars: 13
- Watchers: 12
- Forks: 3
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# Kubeflow MLOps
This repository contains examples of integrated Kubeflow End-to-End Pipelines (KFP) using GitHub actions. Focus is on the creation of pluggable components that can make it easier to build your own pipelines enabling more advanced machine learning projects.
The architecture is shown in the following diagram:
The current pipelines that have been created provide the following pluggable components:
* [Default](pipeline/train/default.py)
* [Convolutional Neural Network (CNN)](pipeline/train/cnn.py)
* [Convolutional Neural Network (CNN) with DataBricks](pipeline/train/cnn_databricks.py)
## KubeFlow
* [List Pipelines](pipeline/list.py)
* [Publish Pipeline](pipeline/publish.py)
* [Run Pipeline](pipeline/run.py)
## Integrations
* [DataBricks](containers/databricks)
## Registration
* [Azure Machine Learning](containers/register-aml)
* [Kubeflow Artifacts](containers/register-kubeflow-artifacts)
* [MLFlow](containers/register-mlflow)
## Scoring
* [Seldon](containers/seldon-score)
* [KFServing](containers/kfservin-score)
## TensorFlow
* [Preprocess](containers/tensorflow-preprocess)
* [Training](containers/tensorflow-training)
## Acknowledgements
Extended with code and lessons learnt from the amazing work done by the Kaizen Team over at [KaizenTM](https://github.com/kaizentm/kubemlops)