https://github.com/st2-ev/ragalligator

A no-code tool to get a baseline model and evaluation set for a RAG application.
https://github.com/st2-ev/ragalligator

cohere no-code rag

Last synced: about 22 hours ago
JSON representation

A no-code tool to get a baseline model and evaluation set for a RAG application.

• Host: GitHub
• URL: https://github.com/st2-ev/ragalligator
• Owner: ST2-EV
• Created: 2024-06-25T00:54:49.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-07-11T17:07:03.000Z (6 months ago)
• Last Synced: 2025-01-16T19:33:04.845Z (5 days ago)
• Topics: cohere, no-code, rag
• Language: Python
• Homepage:
• Size: 20.5 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# RAG Alligator - Alpha [WIP]

A simple ui tool to get a baseline model and evaluation set for a RAG application.

PS: Currently only supports webpages to be used as a knowledgebase and UI is barebones.

#### Motivation

It's very easy to build an impressive looking demo but hard to build a useful application that gets used in production. In my experience, the domain expert and engineer are always different people so I wanted something that could harmonize their efforts. So RAG Alligator's goal is to solve that disconnect by allowing the domain expert to build out an evaluation set and a baseline model very quickly with no code and identify a target value for the for final model to achieve on the created evaluation set.

#### Demo

https://github.com/ST2-EV/ragalligator/assets/40699517/313ff13f-f022-4578-9d09-89bc77c58196

# Installation

```

git clone [email protected]:ST2-EV/ragalligator.git

cd ragalligator

python3 -m venv venv

source venv/bin/activate

pip install -r requirements.txt

export COHERE_API_KEY=...

export OPENAI_API_KEY=sk-...

```

It uses cohere for the rag model and openai to run the evals.

# Run

```

mesop app.py

```

# Todo

- [ ] Remove repition bug in Eval creation tool

- [ ] Add custom component based ui for eval creation tool

- [ ] Show a more detailed progress bar when running the evaluation set

- [ ] Add option to use pdfs as knowledgebase

- [ ] Add option to use docx as knowledgebase

- [ ] Add option to use googledrive as knowledgebase