Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/moeru-ai/easiest
Easy-to-use SillyTavern Starter, based on Docker Compose.
https://github.com/moeru-ai/easiest
docker-compose podman-compose sillytavern
Last synced: 2 days ago
JSON representation
Easy-to-use SillyTavern Starter, based on Docker Compose.
- Host: GitHub
- URL: https://github.com/moeru-ai/easiest
- Owner: moeru-ai
- License: unlicense
- Created: 2024-04-04T14:14:35.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-08-09T13:25:41.000Z (3 months ago)
- Last Synced: 2024-08-10T13:53:29.125Z (3 months ago)
- Topics: docker-compose, podman-compose, sillytavern
- Homepage:
- Size: 13.7 KB
- Stars: 2
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# EasieST
Easy-to-use SillyTavern Starter, based on Docker Compose.
## Usage
###### clone
```bash
git clone https://github.com/moeru-ai/easiest.git
cd easiest
```
###### config
```bash
cp intel.docker-compose.yml docker-compose.yml # Intel oneAPI SYCL
# cp rocm.docker-compose.yml docker-compose.yml # AMD ROCm (TODO)
# cp cuda.docker-compose.yml docker-compose.yml # NVIDIA CUDA (TODO)
# cp vulkan.docker-compose.yml docker-compose.yml # Vulkan (TODO)
nano docker-compose.yml # edit config
```
###### up / down
```bash
sudo docker compose up -d
# podman compose up -d # if you use podman
sudo docker compose down
# podman compose down # if you use podman
```
## FAQ
### Recommended Models (2024-08-09)
> If this section hasn't been updated in a long time, I recommend looking for a
> new model.
> For GGUF format, I recommend `Q5_K_M` or `Q4_K_M` (and imatrix).
- 8B: [Lewdiculous/L3-8B-Stheno-v3.3-32K-GGUF-IQ-Imatrix](https://huggingface.co/Lewdiculous/L3-8B-Stheno-v3.3-32K-GGUF-IQ-Imatrix)
- ST Presets:
- [[LLAMA-3-Context]Roleplay-v1.9.json](https://huggingface.co/Virt-io/SillyTavern-Presets/blob/main/Prompts/LLAMA-3/v1.9/%5BLLAMA-3-Context%5DRoleplay-v1.9.json) => `./sillytavern/data/default-user/context`
- [[LLAMA-3-Instruct]Roleplay-v1.9.json](https://huggingface.co/Virt-io/SillyTavern-Presets/blob/main/Prompts/LLAMA-3/v1.9/%5BLLAMA-3-Instruct%5DRoleplay-v1.9.json) => `./sillytavern/data/default-user/instruct`
- [[Sai]Roleplay.json](https://files.catbox.moe/jxvpek.json) => `./sillytavern/data/default-user/TextGen Settings` (from [here](https://huggingface.co/Virt-io/SillyTavern-Presets/discussions/5#664d6fb87c563d4d95151baa))
- 11B:
[mradermacher/Fimbulvetr-11B-v2.1-16K-i1-GGUF](https://huggingface.co/mradermacher/Fimbulvetr-11B-v2.1-16K-i1-GGUF)
- ST Presets:
- [Lewdicu-Context-3.0.2-eros.json](https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix/blob/main/sillytavern-presets-lewdicu-3.0.2-mistral-0.2/Lewdicu-Context-3.0.2-eros.json)
=> `./sillytavern/data/default-user/context`
- [Lewdicu-Instruct-Alpaca-3.0.2-tentative.json](https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix/blob/main/sillytavern-presets-lewdicu-3.0.2-mistral-0.2/Lewdicu-Instruct-Alpaca-3.0.2-tentative.json)
=> `./sillytavern/data/default-user/instruct`
- [Lewdicu-Samplers-3.0.2.json](https://huggingface.co/Lewdiculous/Eris_PrimeV4-Vision-32k-7B-GGUF-IQ-Imatrix/blob/main/sillytavern-presets-lewdicu-3.0.2-mistral-0.2/Lewdicu-Samplers-3.0.2.json)
=> `./sillytavern/data/default-user/TextGen Settings`
### Why llama.cpp?
`llama.cpp` provides the official docker image for Intel Arc Graphics.
I may change to `ollama` or `koboldcpp` later.
## License
[Unlicense](LICENSE)