https://github.com/zeionara/red-triangle
An http server for connecting russian smart speakers with generative language models
https://github.com/zeionara/red-triangle
Last synced: 3 months ago
JSON representation
An http server for connecting russian smart speakers with generative language models
- Host: GitHub
- URL: https://github.com/zeionara/red-triangle
- Owner: zeionara
- Created: 2024-05-14T21:52:19.000Z (about 1 year ago)
- Default Branch: master
- Last Pushed: 2024-10-29T19:31:26.000Z (7 months ago)
- Last Synced: 2025-01-02T07:46:04.196Z (5 months ago)
- Language: Python
- Size: 137 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Red triangle
A web server for accessing generative language models from a smart speaker
## Eager mode
To evaluate one message and generate response, use the `ask` command:
```sh
python -m rt ask 'Есть такой анекдот' -c openai -m 'gpt-4'
```
## Server mode
To run `http` server which would allow you to interact with the smart speaker and generate responses using external models, use the following command:
```sh
python -m rt serve -c openchat
```
## Notes
To forward requests from `localhost:2222` to `foo.bar:3333`:
```sh
ssh -p 1111 -L 2222:localhost:3333 [email protected]
```
To run ngrok:
```sh
ngrok http --domain=foo-bar.ngrok-free.app 2222
```