https://github.com/cescoffier/quarkus-granite-rag-demo

https://github.com/cescoffier/quarkus-granite-rag-demo

Last synced: 19 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/cescoffier/quarkus-granite-rag-demo
• Owner: cescoffier
• Created: 2024-06-04T11:12:09.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-06-06T06:24:17.000Z (6 months ago)
• Last Synced: 2024-10-17T07:50:18.995Z (about 1 month ago)
• Language: JavaScript
• Size: 31.3 KB
• Stars: 5
• Watchers: 1
• Forks: 4
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Quarkus LLM Demo - Granite RAG

This is a demo of a Retrieval Augmented Generation (RAG) pattern using Quarkus and Langchain4J.

It uses the Granite LLM model to generate text based on a given prompt.

## Prerequisites

- Java 21 or later

- Apache Maven 3.9.6 or later

- Podman or Docker (Podman recommended)

- Granite available using Podman Desktop (AI studio) or InstructLab

*IMPORTANT:* Update the LLM URL in the `application.properties` to match your Granite LLM URL.

## Running the Demo

To run the demo, navigate to the `4-rag` directory and run `mvn quarkus:dev`.

```

> mvn quarkus:dev

```

The UI is available at `http://localhost:8080`.