Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mskry/dotfiles
Alacritty + Fish + Zellij + Starship + Neovim + i3 + Supermaven + Ollama 🦙 = 🚀
https://github.com/mskry/dotfiles
alacritty archlinux archlinux-dotfiles codecompletion codegemma completion dotfiles fish generative-ai i3-config i3wm kickstart-nvim localllm neovim ollama starship-config starship-prompt supermaven zellij zellij-config
Last synced: 8 days ago
JSON representation
Alacritty + Fish + Zellij + Starship + Neovim + i3 + Supermaven + Ollama 🦙 = 🚀
- Host: GitHub
- URL: https://github.com/mskry/dotfiles
- Owner: mskry
- Created: 2022-09-27T20:38:54.000Z (about 2 years ago)
- Default Branch: master
- Last Pushed: 2024-10-30T19:16:33.000Z (about 2 months ago)
- Last Synced: 2024-12-13T00:03:31.681Z (10 days ago)
- Topics: alacritty, archlinux, archlinux-dotfiles, codecompletion, codegemma, completion, dotfiles, fish, generative-ai, i3-config, i3wm, kickstart-nvim, localllm, neovim, ollama, starship-config, starship-prompt, supermaven, zellij, zellij-config
- Language: Shell
- Homepage:
- Size: 589 KB
- Stars: 8
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Setting Up Development Environment for Arch Linux
Install Essential Packages
## Install Essential Packages
1. Install core utilities and development tools:
```bash
pacman -S gcc make man-db bluez bluez-utils unzip fish xclip stow git git-delta base-devel nitrogen docker fish pavucontrol alacritty
```
2. Powerful task runner, version and env management tool for NodeJS, Python, Rust and more.
```bash
curl https://mise.run | sh
# install Arch User Repository helper
mise use -g yay
```
```bash
# you might want to install other tools per user
cat ~/.config/mise/config.toml
[tools]
glow = "latest"
fzf = "latest"
eza = "latest"
zellij = "latest"
zoxide = "latest"
fd = "latest"
ripgrep = "latest"
starship = "latest"
bat = "latest"
pnpm = "latest"
yay = "latest"
usage = "latest"
python = "latest"
deno = "latest"
bun = "latest"
go = "latest"
bottom = "latest"
dust = "latest"
neovim = "latest"
node = "latest"
rust = "latest"
[settings]
experimental = true
```
3. Install the necessary fonts for the system and terminal, including regular, nerd, and emoji fonts:
```bash
yay -S --noconfirm ttf-jetbrains-mono-nerd noto-fonts noto-fonts-emoji
# if you need chinese/japanese/korean support: yay -S noto-fonts-cjk
fc-cache -vf
```
Setting up Docker and Ollama
## Setting up Docker and Ollama
1. Avoid `sudo` for Docker commands:
```bash
# add your user to a docker group
sudo usermod -aG docker $USER
```
2. Install NVIDIA Container Toolkit (if applicable):
```bash
yay -S nvidia-container-toolkit
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker
```
3. Run Ollama inside a Docker container with Open WebUI
- Run Ollama container
```bash
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
```
- Check if Ollama is up and running
```bash
curl -i http://localhost:11434/
```
```
HTTP/1.1 200 OK
Content-Type: text/plain; charset=utf-8
Date: Thu, 05 Sep 2024 14:04:02 GMT
Content-Length: 17
Ollama is running
```
- Run Open WebUI container
The `--add-host=host.docker.internal:host-gateway` flag enables communication between containers using the host's IP address. Will need it to communicate with TTS service later.
```bash
docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda
```
- Open the WebUI
`http://localhost:3000/`
4. Run a model (codegemma ❤️)
CodeGemma is a collection of powerful, lightweight models that can perform a variety of coding tasks like fill-in-the-middle code completion, code generation, natural language understanding, mathematical reasoning, and instruction following.
- `instruct` a 7b instruction-tuned variant for natural language-to-code chat and instruction following
- `code` a 7b pretrained variant that specializes in code completion and generation from code prefixes and/or suffixes
- `2b` a state of the art 2B pretrained variant that provides up to 2x faster code completion
```bash
docker exec -it ollama ollama run codegemma:instruct
```
5. Move Docker root directory (optional):
You might want to move Docker root to a different volume to save the system disk space
I moved Docker root directory to the `/home`, in my case it is mounted to a separate volume:
```bash
# Stop Docker services
sudo systemctl stop docker docker.socket containerd
# Create a new directory (replace `/home/user/new_dir` with your desired location)
sudo mkdir -p /home/user/new_dir
sudo mv /var/lib/docker /home/user/new_dir
```
- Configure Docker root in`daemon.json`:
```bash
sudo vim /etc/docker/daemon.json
```
```json
{
"data-root": "/home/user/new_dir",
"runtimes": {
"nvidia": {
"args": [],
"path": "nvidia-container-runtime"
}
}
}
```
- Restart Docker services for the changes to take effect:
```bash
sudo systemctl restart docker docker.socket containerd
```
- Validate new Docker root location:
```bash
docker info -f '{{ .DockerRootDir}}'
```
6. Integrating `openedai-speech` TTS into Open WebUI
```bash
# expose it throught host.docker.internal:8000 so Open WebUI can access it
docker run -d --gpus=all -p 8000:8000 --add-host=host.docker.internal:host-gateway -v tts-voices:/app/voices -v tts-config:/app/config --name openedai-speech ghcr.io/matatonic/openedai-speech:latest
```
- Open the Open WebUI settings and navigate to the TTS Settings under **Admin Panel > Settings > Audio**.
Text-to-Speech Engine: OpenAI
API Base URL: `http://host.docker.internal:8000/v1`
API Key: `anykey` (note: this is a dummy API key, as `openedai-speech` doesn't require an API key; you can use whatever for this field)
- To make sure those 3 containers start automatically on Docker service start/restart
```bash
docker update --restart=always ollama openedai-speech open-webui
```
