An open API service indexing awesome lists of open source software.

https://github.com/rajagopal17/mcpRAG

rag using Ollama as emebddings, gemini as LLM and MCP server for agentic use
https://github.com/rajagopal17/mcpRAG

Last synced: about 2 months ago
JSON representation

rag using Ollama as emebddings, gemini as LLM and MCP server for agentic use

Awesome Lists containing this project

README

          

# mcpRAG
RAG- using opensource embeddings, opensource vector database and Gemini LLM
______________________________________________________________________________

In this project i have created RAG using txt documents:

Embeddings : 'nomic embeddings' are used with ollama locally
LLM : gemini-2.0-flash
Vector Database : FAISS

All the txt files are chunked with file name, chunk id and chunk text in JSON format and stored locally.
Each chunk is converted into embeddings and collected in a list

This embedding list is indexed using FAISS and stored locally.
when query is embedding using nomic embeddings, these embeddings are searched in FAISS index and relevant indices(location of chunk) is retrieved. These indices are passed to JSON file to get the actual text.

THis text is passed to LLM with the query to formulate the answer.

Additional text is appended to the exiting index and queries are run on the updated index by loading the stored index and embedding file.