https://github.com/schachte/dirtyrag
RAG-based framework designed to work with large language models and vector databases
https://github.com/schachte/dirtyrag
chatgpt langchain large llm openai python rag
Last synced: 2 months ago
JSON representation
RAG-based framework designed to work with large language models and vector databases
- Host: GitHub
- URL: https://github.com/schachte/dirtyrag
- Owner: Schachte
- License: gpl-3.0
- Created: 2024-07-20T17:27:08.000Z (almost 2 years ago)
- Default Branch: master
- Last Pushed: 2024-07-24T00:16:08.000Z (almost 2 years ago)
- Last Synced: 2025-10-07T06:35:02.947Z (9 months ago)
- Topics: chatgpt, langchain, large, llm, openai, python, rag
- Language: Python
- Homepage: https://ryan-schachte.com
- Size: 46.9 KB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# DirtyRAG
A smol [RAG](https://www.databricks.com/glossary/retrieval-augmented-generation-rag)-based framework for working with large language models [(LLMs)](https://en.wikipedia.org/wiki/Large_language_model).
## Motivation
As LLM-based applications scale, especially ones that leverage RAG-based architectures, having more granular control is important. This control should be able to support complex conditional reasoning, hybrid search, agents and more.
## Goals
The goal is to have a minimal LLM RAG framework with support for common RAG-based workflows.
First-class support for popular vector databases to pull embeddings for semantic search (FAISS, ChromaDB, Postgres w/ pgvector) will be imperative to improve relevancy.
Additionally, this tool will have support for building custom agents and tools that can combine with large language models to build complex analysis tools (i.e hybrid search). This will involve defining how iterations are done, chains and conditional reasoning workflows.
# Examples
_Simple RAG based product recommendation tool that leverages a hybrid search approach to reason about it's results_
```txt
🧠Searching Best noise cancelling headphones
----------------------------------------------
Cleansing data...
Parsing content...
Thinking...
----------------------------------------------
RESULTS:
----------------------------------------------
Product: QuietComfort 35 II Noise Cancelling Wireless Headphones
Link: https://global.bose.com/content/consumer_electronics/b2c_catalog/worldwide/websites/en_ae/product/qc35_ii.html
Product: Sony WH1000XM4/B Premium Noise Cancelling Wireless ...
Link: https://electronics.sony.com/audio/headphones/headband/p/wh1000xm4-b
Product: SENNHEISER Momentum 3 Wireless Noise Cancelling ...
Link: https://www.amazon.com/Sennheiser-Momentum-Cancelling-Headphones-Functionality/dp/B07VW98ZKG
```