Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/valiantlynx/ollama-docker
Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment
https://github.com/valiantlynx/ollama-docker
docker docker-compose ollama
Last synced: 29 days ago
JSON representation
Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment
- Host: GitHub
- URL: https://github.com/valiantlynx/ollama-docker
- Owner: valiantlynx
- License: other
- Created: 2024-02-04T23:39:11.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-09-09T23:55:08.000Z (about 2 months ago)
- Last Synced: 2024-09-30T05:24:00.239Z (about 1 month ago)
- Topics: docker, docker-compose, ollama
- Language: Python
- Homepage: https://ollama-docker.azurewebsites.net/
- Size: 46.9 KB
- Stars: 495
- Watchers: 6
- Forks: 104
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
Awesome Lists containing this project
README
# Ollama Docker Compose Setup
Welcome to the Ollama Docker Compose Setup! This project simplifies the deployment of Ollama using Docker Compose, making it easy to run Ollama with all its dependencies in a containerized environment.
[](https://star-history.com/#valiantlynx/ollama-docker&Date)
## Getting Started
### Prerequisites
Make sure you have the following prerequisites installed on your machine:
- Docker
- Docker Compose
#### GPU Support (Optional)
If you have a GPU and want to leverage its power within a Docker container, follow these steps to install the NVIDIA Container Toolkit:
```bash
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
&& curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
sudo apt-get update
sudo apt-get install -y nvidia-container-toolkit
# Configure NVIDIA Container Toolkit
sudo nvidia-ctk runtime configure --runtime=docker
sudo systemctl restart docker
# Test GPU integration
docker run --gpus all nvidia/cuda:11.5.2-base-ubuntu20.04 nvidia-smi
```
### Configuration
1. Clone the Docker Compose repository:
```bash
git clone https://github.com/valiantlynx/ollama-docker.git
```
2. Change to the project directory:
```bash
cd ollama-docker
```
## Usage
Start Ollama and its dependencies using Docker Compose:
if gpu is configured
```bash
docker-compose -f docker-compose-ollama-gpu.yaml up -d
```
else
```bash
docker-compose up -d
```
Visit [http://localhost:8000](http://localhost:8000) in your browser to access Ollama-webui.
### Model Installation
Navigate to settings -> model and install a model (e.g., llava-phi3). This may take a couple of minutes, but afterward, you can use it just like ChatGPT.
### Explore Langchain and Ollama
You can explore Langchain and Ollama within the project. A third container named **app** has been created for this purpose. Inside, you'll find some examples.
### Devcontainer and Virtual Environment
The **app** container serves as a devcontainer, allowing you to boot into it for experimentation. Additionally, the run.sh file contains code to set up a virtual environment if you prefer not to use Docker for your development environment.
if you have vs code and the `Remote Development´ extension simply opening this project from the root will make vscode ask you to reopen in container
## Stop and Cleanup
To stop the containers and remove the network:
```bash
docker-compose down
```
## Contributing
We welcome contributions! If you'd like to contribute to the Ollama Docker Compose Setup, please follow our [Contribution Guidelines](CONTRIBUTING.md).
## License
This project is licensed under the [MIT License](LICENSE). Feel free to use, modify, and distribute it according to the terms of the license. Just give me a mention and some credit
## Contact
If you have any questions or concerns, please contact us at [[email protected]](mailto:[email protected]).
Enjoy using Ollama with Docker Compose! 🐳🚀