Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/evilfreelancer/rugpt-api
Small API reserver for interacting with RuGPT-3
https://github.com/evilfreelancer/rugpt-api
docker flask flask-api rest-api rugpt rugpt-3
Last synced: about 1 month ago
JSON representation
Small API reserver for interacting with RuGPT-3
- Host: GitHub
- URL: https://github.com/evilfreelancer/rugpt-api
- Owner: EvilFreelancer
- License: mit
- Created: 2023-01-27T18:16:29.000Z (about 2 years ago)
- Default Branch: master
- Last Pushed: 2023-02-13T10:06:51.000Z (almost 2 years ago)
- Last Synced: 2024-10-29T20:07:57.295Z (3 months ago)
- Topics: docker, flask, flask-api, rest-api, rugpt, rugpt-3
- Language: Python
- Homepage: https://developers.sber.ru/portal/products/rugpt-3
- Size: 6.84 KB
- Stars: 3
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# ruGPT-3 in Docker
Small API project based on Flask for making requests to RuGPT-3 neural network.
## How to install
First need to build a composition:
```
docker-compose build
```
Run application:
```
docker-compose up -d
```
## How to use
Need to create POST request with JSON object.
```
curl -X POST http://127.0.0.1:5000/predict -H "Content-Type: application/json" -d '{"question":"some text for network"}'
```
## Supported parameters
| Name | Type | Default |
|----------------------|--------|---------------------------------------------------------|
| question | string | |
| max_length | int | 100 |
| device | string | `cuda` (if present) or `cpu` (if cuda is not available) |
| repetition_penalty | float | 5.0 |
| top_k | int | 5 |
| top_p | float | 0.95 |
| temperature | int | 1 |
| num_beams | int | 10 |
| no_repeat_ngram_size | int | 3 |
## Links
* Project based on [boangri/rugpt3-docker](https://github.com/boangri/rugpt3-docker)