https://github.com/afritzler/docker-tensorflow-keras-gpu
Run Tensorflow and Keras with GPU support on Kubernetes
https://github.com/afritzler/docker-tensorflow-keras-gpu
deep-learning docker gpu kubernetes machine-learning tensorflow
Last synced: about 1 year ago
JSON representation
Run Tensorflow and Keras with GPU support on Kubernetes
- Host: GitHub
- URL: https://github.com/afritzler/docker-tensorflow-keras-gpu
- Owner: afritzler
- Created: 2017-03-20T09:34:54.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-03-21T14:32:55.000Z (over 9 years ago)
- Last Synced: 2025-04-23T14:41:41.142Z (about 1 year ago)
- Topics: deep-learning, docker, gpu, kubernetes, machine-learning, tensorflow
- Homepage:
- Size: 18.6 KB
- Stars: 13
- Watchers: 5
- Forks: 5
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# docker-tensorflow-keras-gpu
Base image with Tensorflow and Keras with GPU support. The purpose of this project is to run a single Pod on Kubernetes on a GPU backed node.
# Run it on Kubernetes
First, we need to label the gpu instance (if not already done). If you choose to use a different labeling, you need to adjust the `nodeSelector` part in the `example-pod.yaml` file.
```
kubectl label node gpu="true"
```
__Tricky part ahead:__
In order to use the GPU inside your docker container, you need to pass the location of the NVidia driver on the host into your container. Since the GPU kernel driver on the host has to match the nvidia-driver inside the contianer, we want to decouple that. Adjust the `path` in the `example-pod.yaml` file in case your nvidia-driver location is different.
```
volumes:
- name: nvidia-driver
hostPath:
path: /var/lib/nvidia-docker/volumes/nvidia_driver/latest
```
Now run a simple deployment
```
kubectl create -f example-pod.yaml
```
Attach to the running container
```
kubectl exec -it tensorflow-keras-gpu -- /bin/bash
```
# Lets do some training
Inside the docker container I placed the Keras examples from github. To run a simple training example on the IMDB dataset
```
cd /keras/example
python imdb_cnn.py
```
If your configuration and driver mapping was done correctly, you should see something like that before the training starts.
```
Creating TensorFlow device (/gpu:0) -> (device: 0, name: GeForce GTX TITAN X, pci bus id: 0000:09:00.0)
```
# References
* https://www.tensorflow.org/
* https://keras.io/
* https://kubernetes.io/docs/user-guide/kubectl/kubectl_label/
* https://kubernetes.io/docs/user-guide/kubectl/kubectl_create/
* https://kubernetes.io/docs/user-guide/kubectl/kubectl_exec/