https://github.com/keitabroadwater/llm-eval-lab

A web sandbox for hands-on learning of LLM and RAG Evaluation
https://github.com/keitabroadwater/llm-eval-lab

evaluation-framework fastapi gpt4 llm-evaluation llmops nextjs rag-evaluation ragas

Last synced: about 2 months ago
JSON representation

A web sandbox for hands-on learning of LLM and RAG Evaluation

• Host: GitHub
• URL: https://github.com/keitabroadwater/llm-eval-lab
• Owner: keitabroadwater
• License: mit
• Created: 2025-02-15T00:11:47.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-02-15T01:24:58.000Z (over 1 year ago)
• Last Synced: 2025-05-14T05:23:32.241Z (about 1 year ago)
• Topics: evaluation-framework, fastapi, gpt4, llm-evaluation, llmops, nextjs, rag-evaluation, ragas
• Language: TypeScript
• Homepage:
• Size: 67.4 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# llm-eval-lab

A web sandbox for hands-on learning of LLM and RAG Evaluation

## Interactive LLM & RAG Evaluation Lab

### Why This Matters – Importance of evaluation (MMLU, Ragas, LLM-as-a-judge concepts)

### Key Features – LLM evaluation playground, RAG quality inspection, visual feedback

### Tech Stack – Next.js, FastAPI/Flask, GPT-4, Ragas

Installation:

bash

Copy code

cd frontend && npm install

cd ../backend && pip install -r requirements.txt

### Running the App:

```bash

# Start frontend

cd frontend

npm run dev

# Start backend

cd backend

uvicorn app.main:app --reload

```

### Example Usage – Screenshots or gifs (when ready)

### Evaluation Concepts Explained – Link to docs/ for in-depth evaluation knowledge