https://github.com/substratusai/helm
https://github.com/substratusai/helm
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/substratusai/helm
- Owner: substratusai
- License: apache-2.0
- Created: 2023-10-20T06:32:05.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-08-19T21:34:13.000Z (9 months ago)
- Last Synced: 2025-01-05T09:25:21.201Z (4 months ago)
- Language: Smarty
- Size: 115 KB
- Stars: 16
- Watchers: 2
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Substratus AI Helm Charts
A collection of exquisitely crafted helm charts for LLMs:
- vLLM
- Text Generation Inference
- Lingo
## Enable Substratus Helm repo
```bash
helm repo add substratusai https://substratusai.github.io/helm
helm repo update
```
## Usage guides
### vLLM
Basic usage:
```bash
# Note by default the resource limit is set to 1 GPU
helm install mistral-7b-instruct substratusai/vllm \
--set model=mistralai/Mistral-7B-Instruct-v0.1
```
For Advanced usage see: [vLLM Chart Guide](https://github.com/substratusai/helm/blob/main/charts/vllm/README.md)