https://github.com/muka/ollama-docker

ollama docker compose setup
https://github.com/muka/ollama-docker

Last synced: 28 days ago
JSON representation

ollama docker compose setup

• Host: GitHub
• URL: https://github.com/muka/ollama-docker
• Owner: muka
• License: apache-2.0
• Created: 2024-01-27T08:59:07.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-27T08:59:46.000Z (over 1 year ago)
• Last Synced: 2025-03-30T02:24:50.054Z (about 2 months ago)
• Language: Makefile
• Size: 6.84 KB
• Stars: 10
• Watchers: 1
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# ollama-docker

Example docker compose for ollama. This setup will provide:

- ollama

- ollama-webui

- litellm (openai compatible api)

- redis (caching)

## Usage

Start the services 

`docker compose up -d`

Download a model (can also be done also from webui)

```sh

make ollama/bash

# enter docker image

# See avail models at https://ollama.ai/library

ollama pull "model-name"

```

## Web UI

To use the webui go to http://localhost:3002/

**Note**: create a new user and login to proceed to the chat ui