https://github.com/yeahdongcn/ollamastack
Setup Ollama stack on macOS.
https://github.com/yeahdongcn/ollamastack
Last synced: 9 months ago
JSON representation
Setup Ollama stack on macOS.
- Host: GitHub
- URL: https://github.com/yeahdongcn/ollamastack
- Owner: yeahdongcn
- License: mit
- Created: 2024-01-17T02:20:15.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-31T10:22:16.000Z (over 2 years ago)
- Last Synced: 2025-03-27T14:55:24.378Z (over 1 year ago)
- Language: Swift
- Homepage:
- Size: 11.7 KB
- Stars: 10
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# OllamaStack
Setup [Ollama](https://github.com/jmorganca/ollama) stack on macOS.
- [OllamaStack](#ollamastack)
- [Prerequisites](#prerequisites)
- [Diagram](#diagram)
- [Quickstart](#quickstart)
- [Demo](#demo)
## Prerequisites
* A [Metal capable](https://support.apple.com/en-us/102894) Mac device.
* [Mods](https://github.com/charmbracelet/mods): AI for the command line, built for pipelines.
* [Docker](https://www.docker.com/products/docker-desktop): The fastest way to containerize applications.
## Diagram
```mermaid
graph LR;
subgraph Host
subgraph CLI
B(Mods)
G(Collector)
end
subgraph Server
C(Ollama)
D[Metal]
end
end
subgraph Container
E(LiteLLM Proxy)
F(Ollama Web UI)
H(Prometheus)
I(Grafana)
end
A(User) --> |Terminal|B;
A --> |Browser|F;
B --> |OpenAI API|E;
E --> |REST API|C;
F --> |REST API|C;
C-. Link .-> D;
H --> |Client API|G;
I --> |Data Source|H;
```
## Quickstart
```bash
$ git clone https://github.com/yeahdongcn/OllamaStack.git
$ cd OllamaStack
$ ./start.sh
$ ./stop.sh
```
### Demo
