{"id":20082335,"url":"https://github.com/hariprasath-v/secure_offline_rag_system","last_synced_at":"2026-05-06T14:37:54.517Z","repository":{"id":262598646,"uuid":"887765005","full_name":"hariprasath-v/Secure_Offline_RAG_System","owner":"hariprasath-v","description":"Developing a retrieval system using semantic vector search.","archived":false,"fork":false,"pushed_at":"2024-11-13T09:04:40.000Z","size":21,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-02T13:50:36.809Z","etag":null,"topics":["crossencoder","faiss","python","sentence-transformers","trustii-team"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hariprasath-v.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-13T08:45:50.000Z","updated_at":"2024-11-13T09:04:44.000Z","dependencies_parsed_at":"2024-11-13T09:47:18.580Z","dependency_job_id":null,"html_url":"https://github.com/hariprasath-v/Secure_Offline_RAG_System","commit_stats":null,"previous_names":["hariprasath-v/secure_offline_rag_system"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/hariprasath-v/Secure_Offline_RAG_System","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hariprasath-v%2FSecure_Offline_RAG_System","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hariprasath-v%2FSecure_Offline_RAG_System/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hariprasath-v%2FSecure_Offline_RAG_System/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hariprasath-v%2FSecure_Offline_RAG_System/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hariprasath-v","download_url":"https://codeload.github.com/hariprasath-v/Secure_Offline_RAG_System/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hariprasath-v%2FSecure_Offline_RAG_System/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32698709,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-06T08:33:17.875Z","status":"ssl_error","status_checked_at":"2026-05-06T08:33:17.221Z","response_time":117,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crossencoder","faiss","python","sentence-transformers","trustii-team"],"created_at":"2024-11-13T15:43:02.135Z","updated_at":"2026-05-06T14:37:54.501Z","avatar_url":"https://github.com/hariprasath-v.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Secure_Offline_RAG_System\n\n### Developing a retrieval system using semantic vector search.\n\n### Competition hosted on [Trustii.io](https://app.trustii.io/datasets/1529)\n\n## Objectives of this challenge\nBuild a Flexible Local RAG System: Develop a RAG system that generates embeddings using an open-source LLM, the system must support local execution without relying on external API calls. The system should be flexible and capable of handling various types of text data, including but not limited to Q\u0026A datasets, websites, code snippets, documentation, and more.\n\nCreate a Versatile Local Chat Interface: Build a chat interface that interacts with the vector store generated from text embeddings and stored locally. This interface should allow users to query embeddings and retrieve relevant information to generate responses through locally executed LLM. The interface should support interaction with different content types, multiple languages specifically handling queries in English and French, code snippets, etc demonstrating the system's flexibility.\n\n## My Approach\n- Created embeddings using the sentence-transformers model: multi-qa-MiniLM-L6-cos-v1.\n- Built a FAISS HNSW index with the embeddings for efficient vector search.\n- Retrieved the top 10 results using dense embeddings, created query-response pairs from these results, and re-ranked them using a cross-encoder model ms-marco-MiniLM-L-12-v2.\n  \n## How to Run\nSimply follow the steps in the provided Jupyter Notebook.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhariprasath-v%2Fsecure_offline_rag_system","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhariprasath-v%2Fsecure_offline_rag_system","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhariprasath-v%2Fsecure_offline_rag_system/lists"}