https://github.com/fly-apps/localai-demo
LocalAI demo app on Fly.io
https://github.com/fly-apps/localai-demo
gpu
Last synced: 9 months ago
JSON representation
LocalAI demo app on Fly.io
- Host: GitHub
- URL: https://github.com/fly-apps/localai-demo
- Owner: fly-apps
- Created: 2023-10-18T17:57:11.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-11-16T14:24:25.000Z (over 2 years ago)
- Last Synced: 2024-11-17T00:25:58.483Z (over 1 year ago)
- Topics: gpu
- Language: Shell
- Homepage: https://fly.io/docs/gpus/gpu-quickstart/
- Size: 585 KB
- Stars: 2
- Watchers: 10
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# LocalAI demo app for Fly.io
First deploy with:
```
fly apps create localai-demo
fly deploy
```
Run `./cli` and/or see https://localai.io/ for Rest API.
## Examples
```
$ ./cli chat "tell me something nice about fly.io"
{"object":"chat.completion","model":"gpt-3.5-turbo","choices":[{"index":0,"finish_reason":"stop","message":{"role":"assistant","content":"We love fly.io because it's a platform that makes it easy for developers to build and deploy applications with minimal friction. It's also a great way to connect with other developers, share knowledge, and collaborate on open source projects."}}],"usage":{"prompt_tokens":0,"completion_tokens":0,"total_tokens":0}}
```