https://github.com/bmorphism/kfsummit19
Example of running kubeflow pipelines on Anthos (lightning talk at Kubeflow Summit 2019)
https://github.com/bmorphism/kfsummit19
Last synced: 11 months ago
JSON representation
Example of running kubeflow pipelines on Anthos (lightning talk at Kubeflow Summit 2019)
- Host: GitHub
- URL: https://github.com/bmorphism/kfsummit19
- Owner: bmorphism
- Created: 2019-10-28T14:18:58.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2019-10-28T16:40:46.000Z (over 6 years ago)
- Last Synced: 2025-07-05T07:59:27.592Z (12 months ago)
- Language: Python
- Homepage:
- Size: 11.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Kubeflow Pipelines on Anthos
This is an example of a pipeline designed for execution on kubeflow depolyed Anthos / GKE on-prem.
The example is liberally adapted from CIFAR-10 sample contributed by nvidia https://github.com/kubeflow/pipelines/tree/master/samples/contrib/nvidia-resnet
## Prerequisites
- kubeflow deployed on Anthos with:
https://github.com/kubeflow/manifests/blob/master/kfdef/kfctl_anthos.yaml
- VMWare standard storage PV / PVC for pipeline artifacts
## How to run
This assumes 'kfsummit' namespace.
0. Create PV / PVC
`kubectl apply -f pv.yaml`
`kubectl apply -f pvc.yaml`
1. Forward istio-ingress
`kubectl port-forward svc/istio-ingressgateway -n gke-system 9080:80`
2. Using kfp SDK, launch the pipeline:
```python
import kfp
c = kfp.Client("127.0.0.1:8082/pipeline", namespace="kfsummit")
c.create_run_from_pipeline_package("resnet_kfsummit.tar.gz", arguments={}, experiment_name="kfsummit")
```