https://github.com/basetenlabs/truss-examples
Examples of models deployable with Truss
https://github.com/basetenlabs/truss-examples
ai docker examples machine-learning mlops python
Last synced: about 1 year ago
JSON representation
Examples of models deployable with Truss
- Host: GitHub
- URL: https://github.com/basetenlabs/truss-examples
- Owner: basetenlabs
- License: mit
- Created: 2023-07-17T02:16:09.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2024-10-30T00:29:00.000Z (over 1 year ago)
- Last Synced: 2024-10-30T02:50:37.302Z (over 1 year ago)
- Topics: ai, docker, examples, machine-learning, mlops, python
- Language: Python
- Homepage: https://trussml.com
- Size: 33.1 MB
- Stars: 138
- Watchers: 14
- Forks: 37
- Open Issues: 65
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
# Truss Examples
[](https://github.com/basetenlabs/truss-examples/actions/workflows/test-examples.yml)
Truss is the simplest way to serve AI/ML models in production.
To get you started with [Truss](https://truss.baseten.co/), this repository has dozens of example models, each ready to deploy as-is or adapt to your needs.
## Installation
Get the repository with:
```
git clone https://github.com/basetenlabs/truss-examples
```
Install Truss with:
```
pip install --upgrade truss
```
## Deployment
Pick a model to deploy by passing a path to that model.
```bash
$ # From the truss-examples directory
$ truss push 02-llm
```
This will prompt you for an API Key -- fetch one from the
[Baseten API keys page](https://app.baseten.co/settings/account/api_keys).
## Invocation
Invocation depends on the model's input and output specifications. See individual model READMEs for invocation details.
# Contibuting
We welcome contributions of new models and improvements to existing models. See [CONTRIBUTING.md](CONTRIBUTING.md) for details.