https://github.com/frap129/koboldcpp-docker
Docker container build files and compose file for koboldcpp
https://github.com/frap129/koboldcpp-docker
Last synced: 4 months ago
JSON representation
Docker container build files and compose file for koboldcpp
- Host: GitHub
- URL: https://github.com/frap129/koboldcpp-docker
- Owner: frap129
- Created: 2023-04-19T00:17:36.000Z (about 3 years ago)
- Default Branch: master
- Last Pushed: 2023-11-20T17:39:00.000Z (over 2 years ago)
- Last Synced: 2025-01-23T22:35:28.260Z (over 1 year ago)
- Language: Dockerfile
- Size: 1000 Bytes
- Stars: 1
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# koboldcpp Docker
Run koboldcpp as a docker container with docker-compose.
Link to the original project, [koboldcpp](https://github.com/LostRuins/koboldcpp)
Clone this, cd into it, make a directory named `models`, and put a koboldcpp compatible model in it.
Next, edit the `docker-compose.yml` file and change the file name in the `MODEL` variable to your model.
Build:
```
docker-compose -f docker-compose.yml build
```
Run:
```
docker-compose -f docker-compose.yml up -d
```