An open API service indexing awesome lists of open source software.

https://github.com/skywardai/lupiniii

Restful API aggregators in Rust which focus on high performance, Rust AI frameworks and smaller size image
https://github.com/skywardai/lupiniii

embeddings inference localai openai-api restful-api rust

Last synced: 2 days ago
JSON representation

Restful API aggregators in Rust which focus on high performance, Rust AI frameworks and smaller size image

Awesome Lists containing this project

README

          

# lupinIII

RESTful API aggregator for high performance and smaller size image requirements.

# Installation

```bash
cargo build

cargo run
```

# Server/Swagger address
```
http://localhost:8080
http://localhost:8080/docs
```

# Inference engine candidates

* https://github.com/Tracel-AI/burn
* https://github.com/huggingface/candle