https://github.com/mathieu-benoit/sample-score-genai-app
https://github.com/mathieu-benoit/sample-score-genai-app
Last synced: 14 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/mathieu-benoit/sample-score-genai-app
- Owner: mathieu-benoit
- Created: 2025-10-22T01:42:28.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-10-30T01:35:35.000Z (7 months ago)
- Last Synced: 2025-10-30T03:40:37.800Z (7 months ago)
- Language: Go
- Size: 49.8 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# sample-score-genai-app
- [`hello-genai-in-go`](./hello-genai-in-go/)
- [`open-webui`](./open-webui/)
TODOs:
- [ ] Codespace setup with DMR
- [ ] Kubernetes
- https://docs.docker.com/ai/model-runner/api-reference/
- https://github.com/AdminTurnedDevOps/agentic-demo-repo/blob/main/kagent-oss/llama-k8s-agentic/setup-llama.md
- https://github.com/docker/model-runner/blob/main/charts/docker-model-runner/templates/deployment.yaml
- https://k33g.hashnode.dev/first-contact-with-docker-model-runner-in-golang#heading-run-the-program-using-docker-compose
- https://github.com/Reshrahim/todoapp-ai/blob/main/recipes/kubernetes-llama/main.tf
- https://github.com/docker/compose-bridge-transformer
With Ollama:
```mermaid
sequenceDiagram
Command->>+Files: score-compose init
Files-->>+Files: ollama.tpl
Files-->>+Files: ollama-puller-provisioner.yaml
Command->>+Files: score-compose generate
Files-->>+Files: compose.yaml
Command->>+Docker: docker compose up
Docker-->>+Docker: ollama pull gemma3:270m
Docker-->>+Docker: ollama pull smollm2:135m
```
With DMR:
```mermaid
sequenceDiagram
Command->>+Files: score-compose init
Files-->>+Files: dmr-service-provisioner.yaml
Command->>+Files: score-compose generate
Files-->>+Files: compose.yaml
Command->>+Docker: docker compose up
Docker-->>+Docker: docker model pull ai/smollm2
Docker-->>+Docker: docker model pull ai/gemma3
```
## Resources:
- https://github.com/docker/hello-genai
- https://k33g.hashnode.dev/first-contact-with-docker-model-runner-in-golang
- https://dev.to/ajeetraina/docker-model-runner-cheatsheet-2025-37nd
- https://www.docker.com/blog/local-llm-tool-calling-a-practical-evaluation/