https://github.com/teknoir/triton-helm
Triton Inference Server Helm Chart
https://github.com/teknoir/triton-helm
Last synced: 7 months ago
JSON representation
Triton Inference Server Helm Chart
- Host: GitHub
- URL: https://github.com/teknoir/triton-helm
- Owner: teknoir
- Created: 2024-11-18T16:49:44.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-11-22T08:32:16.000Z (11 months ago)
- Last Synced: 2025-01-30T08:31:40.617Z (9 months ago)
- Homepage: https://teknoir.cloud
- Size: 12.7 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Triton Inference Server Helm Chart
This chart deploys the Triton Inference Server to a Kubernetes cluster.
> The implementation of the Helm chart is right now the bare minimum to get it to work.
## Usage in Teknoir platform
Use the HelmChart to deploy the Triton Inference Server to a Device.
```yaml
---
apiVersion: helm.cattle.io/v1
kind: HelmChart
metadata:
name: triton
namespace: default
spec:
repo: https://teknoir.github.io/triton-helm
chart: triton
targetNamespace: default
valuesContent: |-
# The path to the models directory
modelRepositoryPath: /opt/teknoir/models
# Models to be installed via a shared mounted host path (volume)
models: []
```
## Example values.yaml
```yaml
models:
- name: rtdetr
image: us-docker.pkg.dev/teknoir/gcr.io/rtdetr-triton:latest
- name: up_down_classifier
image: us-docker.pkg.dev/teknoir/gcr.io/up-down-classifier-triton:latest
```
## Adding the repository
```bash
helm repo add teknoir-triton https://teknoir.github.io/triton-helm/
```
## Installing the chart
```bash
helm install triton teknoir-triton/triton -f values.yaml
```