https://github.com/mgross21/anon-ai
Containerized service to run LLM locally with anonymous internet proxy
https://github.com/mgross21/anon-ai
anonymity linux local-ai ollama open-webui privacy programming searxng tor
Last synced: about 1 month ago
JSON representation
Containerized service to run LLM locally with anonymous internet proxy
- Host: GitHub
- URL: https://github.com/mgross21/anon-ai
- Owner: MGross21
- Created: 2025-07-04T07:45:48.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2025-08-19T08:01:12.000Z (about 2 months ago)
- Last Synced: 2025-08-19T10:35:56.352Z (about 2 months ago)
- Topics: anonymity, linux, local-ai, ollama, open-webui, privacy, programming, searxng, tor
- Language: Shell
- Homepage:
- Size: 79.1 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Local AI
Provides a fully self-hosted AI stack for private, local language model inference and search, with a strong focus on privacy.
> [!WARNING]
> **Minimum System Requirements**
>
> - **Disk Space:** ~15 GB
> - **RAM:** 11 GB
## Overview
This repository integrates four primary software components:
1. **Ollama** – Local large language model serving.
2. **SearXNG** – Privacy-focused, anonymized search engine.
3. **Open WebUI** – User-friendly chat interface for interaction.
4. **Tor** – Enables anonymous network access and search through the Tor network.
## Instructions
### Install Required Packages
#### Docker
```bash
sudo docker docker-compose
```
### System Services and Permissions
Following [this tutorial](https://docs.docker.com/engine/install/linux-postinstall/),
```bash
sudo systemctl start docker # may take some time
sudo systemctl enable docker
sudo groupadd docker # optional, group may already exist
sudo usermod -aG docker $USER
newgrp docker # activate changes
```
#### Optional Test
```bash
docker run hello-world
```
*If you encounter permission errors, it is recommended to reboot your system to ensure that group membership changes take effect.*
### Donwload Repository
```bash
git clone https://github.com/MGross21/local-ai
cd local-ai
```
### Starting up
[See other models here](https://ollama.com/library?sort=popular)
```bash
docker compose up -d
```
### Opening Stack
| Service | URL/Port | Preview |
|-----------------|------------------------|----------------------------------|
| Web UI | [localhost:3000](http://localhost:3000/) |  |
| SearXNG | [localhost:8080](http://localhost:8080/) |  |
| Ollama API | [localhost:11435](http://localhost:11435/) | `Ollama is running` |
### Shutdown
```bash
docker compose down
```