Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/adammikulis/EdgeRag

EdgeRag is a program that runs large language models and vector databases on your local device
https://github.com/adammikulis/EdgeRag

Last synced: 13 days ago
JSON representation

EdgeRag is a program that runs large language models and vector databases on your local device

Awesome Lists containing this project

README

        

# EdgeRag
EdgeRag is a Retrieval Augmented Generative (RAG) Artificial Intelligence (AI) pipeline that is based on [LLamaSharp](https://github.com/SciSharp/LLamaSharp) and Microsoft's [Kernel Memory](https://github.com/microsoft/kernel-memory). It uses Godot 4.2.1 mono and requires .NET8. You can run many popular models (llama, mistral, mixtral, phi) and add nearly any sort of document to the vector database to query.

Download a Mistral model from here: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF

Download a Phi model from here: https://huggingface.co/TheBloke/phi-2-GGUF