Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/anmiralles/quarkus-ai-llm-translator
Quarkus project to showcase an AI LLM REST service based on llama3.1 for text and files.
https://github.com/anmiralles/quarkus-ai-llm-translator
ai llm quarkus reactive
Last synced: 20 days ago
JSON representation
Quarkus project to showcase an AI LLM REST service based on llama3.1 for text and files.
- Host: GitHub
- URL: https://github.com/anmiralles/quarkus-ai-llm-translator
- Owner: anmiralles
- Created: 2024-08-07T08:14:29.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2024-08-08T10:57:08.000Z (3 months ago)
- Last Synced: 2024-10-10T11:40:13.186Z (about 1 month ago)
- Topics: ai, llm, quarkus, reactive
- Language: Java
- Homepage:
- Size: 10.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# quarkus-ai-llm-translator
This project uses Quarkus to create a translatin REST service for test and files. It uses Ollama (llama3.1) LLM in order to do the task.
## Running the application in dev mode
You can run your application in dev mode that enables live coding using:
```shell script
./mvnw compile quarkus:dev
```
> **_NOTE:_** Quarkus now ships with a Dev UI, which is available in dev mode only at .
## Testing the service
Once the application is running then you can send rest calls like these ones:
```shell script
http POST http://localhost:8080/translate/text text="Esto es un test" language="english"
```
Previous to the next one, just create a file ("file.txt") and put some text on it to translate.
```shell script
http -f POST http://localhost:8080/translate/file [email protected]
```
## Related Guides
- LangChain4j Ollama ([guide](https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html)): Provides the basic integration of Ollama with LangChain4j
## Provided Code
### RESTEasy JAX-RS
Easily start your RESTful Web Services
[Related guide section...](https://quarkus.io/guides/getting-started#the-jax-rs-resources)
# quarkus-ai-llm-translator