https://github.com/sourcec0de/kuzco-amdgpu
A simple repo showcasing how to run kuzco.xyz in a docker container mounting amdgpu's rocm
https://github.com/sourcec0de/kuzco-amdgpu
Last synced: about 1 year ago
JSON representation
A simple repo showcasing how to run kuzco.xyz in a docker container mounting amdgpu's rocm
- Host: GitHub
- URL: https://github.com/sourcec0de/kuzco-amdgpu
- Owner: sourcec0de
- License: mit
- Created: 2024-06-19T20:45:06.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-06-20T12:56:23.000Z (almost 2 years ago)
- Last Synced: 2024-06-21T10:59:49.195Z (almost 2 years ago)
- Language: Dockerfile
- Size: 8.79 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# kuzco-amdgpu (WIP)
> This repo is a work-in-progress and for demonstrational purposes.
> A simple repo showcasing how to run kuzco.xyz in a docker container mounting amdgpu's rocm
# Warning
> Kuzco [recently announced][ban-announ] that a restart policy may result in getting your worker banned.
# Overview
As of 2024/06/19 the default kuzco container doesn't seem suited for AMD gpu's.
I would recommend watching their discord server for official support in the future.
# Setup (Ubuntu 22.04 host)
### TODO
- [ ] Install AMD drivers on linux host
- [ ] Install docker (don't use docker desktop, use docker-engine)
- [ ] Double check the GPU is properly configured
# Docker
Rather than baking the models into the container this example demonstrates how to mount a local directory to cache any large files.
# Building
```sh
docker compose build
```
# Running
```sh
export WORKER_ID="YOUR_ID"
export WORKER_CODE="YOUR_CODE"
docker compose up -d
docker compose log -f
```
# Scaling
## TODO
- [ ] Add `replicas` key to the docker-compose.yaml file
[ban-announ]: https://discord.com/channels/1100110477599723550/1215659199846154261/1253105879386034228