An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with retrieval

A curated list of projects in awesome lists tagged with retrieval .

https://github.com/chonkie-ai/chonkie

🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library

ai chunking etl nlp python rag retrieval semantic-segmentation text-chunking text-processing text-splitting vector-search

Last synced: 14 May 2025

https://github.com/memodb-io/memobase

Profile-Based Long-Term Memory for AI Applications. Memobase handles user profiles, memory events, and evolving context — perfect for chatbots, companions, tutors, customer service bots, and all chat-based agents.

ai-companion ai-memory chatgpt llm-application llm-memory long-term-memory memory rag retrieval user-memory

Last synced: 30 Oct 2025

https://github.com/intel/intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

4-bits autoround chatbot chatpdf gaudi3 habana intel-optimized-llamacpp large-language-model llm-cpu llm-inference neural-chat neural-chat-7b rag retrieval speculative-decoding streamingllm

Last synced: 03 Jul 2026

https://github.com/VectifyAI/OpenKB

OpenKB: Open LLM Knowledge Base

agents ai knowledge-base llm rag retrieval

Last synced: 28 May 2026

https://github.com/beir-cellar/beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

benchmark bert colbert dataset deep-learning dpr elasticsearch information-retrieval llm nlp passage-retrieval pytorch question-generation rag retrieval retrieval-models sbert sentence-transformers zero-shot-retrieval

Last synced: 14 May 2025

https://github.com/xhluca/bm25s

Fast BM25 search in Python, powered by Numpy and Numba

bm25 bm25-l bm25-plus information-retrieval lexical-search okapi-bm25 rag retrieval robertson search

Last synced: 29 Apr 2026

https://github.com/qdrant/fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

embeddings openai rag retrieval retrieval-augmented-generation vector-search

Last synced: 26 Mar 2025

https://github.com/superlinked/superlinked

Superlinked is a Python framework for AI Engineers building high-performance search & recommendation applications that combine structured and unstructured data.

data-pipeline deep-learning embeddings etl information-retrieval llm ml mlops natural-language-processing nlp python retrieval retrieval-augmented-generation semantic-search vector-database vector-search vectorization

Last synced: 16 Jan 2026

https://github.com/epsilla-cloud/vectordb

Epsilla is a high performance Vector Database Management System. Try out hosted Epsilla at https://cloud.epsilla.com/

ai chatgpt data data-science database embeddings embeddings-similarity infrastructure llms machine-learning neural-network neural-search rag retrieval search-engine vector-database vector-search

Last synced: 15 May 2025

https://github.com/tensorlakeai/indexify

A realtime serving engine for Data-Intensive Generative AI Applications

llm machine-learning retrieval

Last synced: 01 Mar 2026

https://github.com/lucidrains/retro-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

artificial-intelligence attention-mechanism deep-learning retrieval transformers

Last synced: 15 May 2025

https://github.com/lucidrains/RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

artificial-intelligence attention-mechanism deep-learning retrieval transformers

Last synced: 03 Apr 2025

https://github.com/neumtry/neumai

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

ai chatgpt data data-engineering database embeddings etl llm llmops mlops ops pipeline python rag retrieval vector-database vectors

Last synced: 29 Oct 2025

https://github.com/AnswerDotAI/byaldi

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

colbert colpali multi-modal nlp rag reranking retrieval

Last synced: 06 Jun 2026

https://github.com/NeumTry/NeumAI

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

ai chatgpt data data-engineering database embeddings etl llm llmops mlops ops pipeline python rag retrieval vector-database vectors

Last synced: 11 Apr 2025

https://github.com/ArrowLuo/CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

activitynet clip didemo lsmdc msrvtt msvd multimodal multimodal-learning multimodality ranking retrieval retrieval-model search video-clip-retrieval video-text-retrieval

Last synced: 03 Apr 2025

https://github.com/anush008/fastembed-rs

Rust library for vector embeddings and reranking. Inspired by qdrant/fastembed.

embeddings fastembed rag reranker reranking retrieval retrieval-augmented-generation vector-search

Last synced: 19 Feb 2026

https://github.com/michaelthwan/searchGPT

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

ai chatgpt grounded-api grounded-bot language-model llm machine-learning nlp nlp-machine-learning openai python retrieval retrieval-model

Last synced: 27 Apr 2025

https://github.com/lucidrains/memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

approximate-nearest-neighbors artificial-intelligence attention-mechanism deep-learning memory retrieval transformers

Last synced: 16 May 2025

https://github.com/BUAADreamer/EasyRAG

Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案

aiops bge bm25 ccf glm4 gte hyde llm minicpm network-operations qa rag retrieval retrieval-augmented-generation rrf

Last synced: 26 Jun 2026

https://github.com/michaelthwan/searchgpt

Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.

ai chatgpt grounded-api grounded-bot language-model llm machine-learning nlp nlp-machine-learning openai python retrieval retrieval-model

Last synced: 21 Apr 2025

https://github.com/redis-developer/arxivchatguru

Use ArXiv ChatGuru to talk to research papers. This app uses LangChain, OpenAI, Streamlit, and Redis as a vector database/semantic cache.

ai arxiv langchain machine-learning openai python question-answering rag redis retrieval retrieval-augmented-generation streamlit vector-database vector-search

Last synced: 15 May 2025

https://github.com/redis-developer/ArXivChatGuru

Use ArXiv ChatGuru to talk to research papers. This app uses LangChain, OpenAI, Streamlit, and Redis as a vector database/semantic cache.

ai arxiv langchain machine-learning openai python question-answering rag redis retrieval retrieval-augmented-generation streamlit vector-database vector-search

Last synced: 11 Apr 2025

https://github.com/redis-developer/ArxivChatGuru

Use ArXiv ChatGuru to talk to research papers. This app uses LangChain, OpenAI, Streamlit, and Redis as a vector database/semantic cache.

ai arxiv langchain machine-learning openai python question-answering rag redis retrieval retrieval-augmented-generation streamlit vector-database vector-search

Last synced: 18 Jul 2025

https://github.com/datascienceuibk/rankify

🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Reranking models, and multiple RAG methods.

agent ai chatgpt information-retrieval llm nlp question-answering rag ranked-retrieval reranking retrieval retrival-augmented-generation

Last synced: 15 Oct 2025

https://github.com/Anush008/fastembed-rs

Rust library for generating vector embeddings, reranking locally

embeddings fastembed rag reranker reranking retrieval retrieval-augmented-generation vector-search

Last synced: 01 May 2025

https://github.com/akariasai/learning_to_retrieve_reasoning_paths

The official implementation of ICLR 2020, "Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering".

hotpotqa multi-hop-reasoning natural-questions open-domain-qa reading-comprehension retrieval squad

Last synced: 11 Oct 2025

https://github.com/kareldo/xmc.dspy

In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.

information-extraction prompt-engineering retrieval retrieval-augmented-generation

Last synced: 13 May 2025

https://github.com/sapienzanlp/relik

Retrieve, Read and LinK: Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget (ACL 2024)

acl2024 bert entity-linking huggingface natural-language-processing nlp relation-extraction retrieval retriever-reader span-extraction transformers triplet-extraction wikipedia

Last synced: 16 May 2025

https://github.com/TIGER-AI-Lab/OpenResearcher

OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis

deep-research llm retrieval

Last synced: 05 Mar 2026

https://github.com/tonywu71/colpali-cookbooks

Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳

colpali cookbooks rag retrieval search vision-language-model

Last synced: 11 Jul 2025

https://github.com/parthsarthi03/raptor

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

agents clustering framework language-model llm machine-learning rag retrieval retrieval-augmented-generation vector-database

Last synced: 06 Mar 2025

https://github.com/arcee-ai/DALM

Domain Adapted Language Modeling Toolkit - E2E RAG

language-model llm retrieval retrieval-augmented-generation

Last synced: 22 Jul 2025

https://github.com/arcee-ai/dalm

Domain Adapted Language Modeling Toolkit - E2E RAG

language-model llm retrieval retrieval-augmented-generation

Last synced: 04 Apr 2025

https://github.com/DataScienceUIBK/rankify

🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pre-retrieved benchmark datasets and supports 7+ retrieval techniques, 24+ state-of-the-art Reranking models, and multiple RAG methods.

agent ai chatgpt information-retrieval llm nlp question-answering rag ranked-retrieval reranking retrieval retrival-augmented-generation

Last synced: 29 Mar 2025

https://github.com/chao1224/MoleculeSTM

Multi-modal Molecule Structure-text Model for Text-based Editing and Retrieval, Nat Mach Intell 2023 (https://www.nature.com/articles/s42256-023-00759-6)

clip computation-chemistry drug-discovery editing foundation-model molecule-editing moleculeclip moleculestm pretraining retrieval

Last synced: 09 May 2025

https://github.com/chao1224/moleculestm

Multi-modal Molecule Structure-text Model for Text-based Editing and Retrieval, Nat Mach Intell 2023 (https://www.nature.com/articles/s42256-023-00759-6)

clip computation-chemistry drug-discovery editing foundation-model molecule-editing moleculeclip moleculestm pretraining retrieval

Last synced: 13 Apr 2025

https://github.com/meinardmueller/libfmp

libfmp - Python package for teaching and learning Fundamentals of Music Processing (FMP)

audio beat chord dtw f0 fourier hmm mir music nmf onset processing python retrieval synchronization tempo

Last synced: 16 May 2025

https://github.com/firecrawl/rag-arena

Open-source RAG evaluation through users' feedback

ai chatbot langchain langchain-typescript mendable nextjs rag retrieval

Last synced: 24 Aug 2025

https://github.com/fasterdecoding/rest

REST: Retrieval-Based Speculative Decoding, NAACL 2024

llm-inference retrieval speculative-decoding

Last synced: 16 May 2025

https://github.com/FasterDecoding/REST

REST: Retrieval-Based Speculative Decoding, NAACL 2024

llm-inference retrieval speculative-decoding

Last synced: 07 May 2025

https://github.com/KarelDO/xmc.dspy

In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.

information-extraction prompt-engineering retrieval retrieval-augmented-generation

Last synced: 19 Apr 2025

https://github.com/illuin-tech/vidore-benchmark

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

colpali rag retrieval search vision-language-model

Last synced: 12 Apr 2025

https://github.com/naver/bergen

Benchmarking library for RAG

augmentation generation llms rag retrieval

Last synced: 13 Apr 2025

https://github.com/zou-group/avatar

AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)

agents knowledge-base llms retrieval tool-use

Last synced: 13 May 2025

https://github.com/jxmorris12/cde

code for training & evaluating Contextual Document Embedding models

embeddings retrieval

Last synced: 05 Apr 2025

https://github.com/ARM-DOE/ACT

Atmospheric data Community Toolkit - A python based toolkit for exploring and analyzing time series atmospheric datasets

atmospheric-science corrections meteorological-data meteorology retrieval time-series visualization

Last synced: 20 Jul 2025

https://github.com/m-bain/condensedmovies

Story-Based Retrieval with Contextual Embeddings. Largest freely available movie video dataset. [ACCV'20]

dataset precomputed-features retrieval source-videos video-text-retrieval

Last synced: 20 Aug 2025

https://github.com/arm-doe/act

Atmospheric data Community Toolkit - A python based toolkit for exploring and analyzing time series atmospheric datasets

atmospheric-science corrections meteorological-data meteorology retrieval time-series visualization

Last synced: 24 Jan 2026

https://github.com/luyug/COIL

NAACL2021 - COIL Contextualized Lexical Retriever

retrieval

Last synced: 29 Apr 2025

https://github.com/zjunlp/onegen

[EMNLP 2024 Findings] OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs.

artificial-intelligence efficient generation large-language-models llm natural-language-processing onegen rag retrieval retrieval-augmented-generation transformer

Last synced: 13 Jun 2025

https://github.com/zjunlp/OneGen

[EMNLP 2024 Findings] OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs.

artificial-intelligence efficient generation large-language-models llm natural-language-processing onegen rag retrieval retrieval-augmented-generation transformer

Last synced: 07 May 2025

https://github.com/mendableai/rag-arena

RAG Arena is an open-source Next.js project made by Mendable.ai that interfaces with LangChain to provide a RAG chatbot experience where queries receive multiple responses. Users vote on these responses, which are then unblurred to reveal the Retriever used, differentiating the chatbots by their data retrieval methods.

ai chatbot langchain langchain-typescript mendable nextjs rag retrieval

Last synced: 14 Apr 2025

https://github.com/DRSY/MoTIS

[NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP)

ai clip cross-modal image-search ios-swift k-means k-means-clustering knn knowledge-distillation lsh naacl random-projection retrieval semantic-search vector-search

Last synced: 08 May 2025

https://github.com/anush008/fastembed-js

Library to generate vector embeddings in NodeJS

embeddings rag retrieval retrieval-augmented-generation vector-search

Last synced: 30 Oct 2025

https://github.com/Reason-Wang/ToolGen

The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"

agent llm nlp retrieval tool tool-learning tool-retrieval toolgen

Last synced: 24 Oct 2025

https://github.com/Anush008/fastembed-js

Library to generate vector embeddings in NodeJS

embeddings rag retrieval retrieval-augmented-generation vector-search

Last synced: 06 Mar 2025

https://github.com/xlang-ai/bright

BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval

benchmark reasoning retrieval

Last synced: 07 Apr 2025

https://github.com/dataplayer12/fly-lsh

An implementation of efficient LSH inspired by fruit fly brain

locality-sensitive-hashing machine-learning-algorithms nearest-neighbor-search retrieval

Last synced: 21 Mar 2025

https://github.com/lucidrains/marge-pytorch

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

artificial-intelligence deep-learning pre-training retrieval transformers

Last synced: 22 Jun 2025

https://github.com/langboat/mengzi-retrieval-lm

An experimental implementation of the retrieval-enhanced language model

artificial-intelligence attention-mechanism deep-learning gpt language-model retrieval transformer

Last synced: 07 May 2025

https://github.com/axflow/original-demo-ui

Demo UI for the axgen library

augmented context framework llm rag retrieval

Last synced: 05 May 2025

https://github.com/neulab/retomaton

PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)

icml-2022 knn knn-lm language modeling nearest nearest-neighbor neuro-symbolic neurosymbolic pytorch retomaton retrieval

Last synced: 12 Oct 2025

https://github.com/denser-org/denser-chat

Chat with PDF files with source highlights

ai chatbot nlp pdf retrieval retrieval-augmented-generation

Last synced: 20 Sep 2025

https://github.com/tiger-ai-lab/uniir

Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers"

language-model retrieval

Last synced: 13 Jun 2025

https://github.com/lucidrains/retrieval-augmented-ddpm

Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch

artificial-intelligence deep-learning image-generation retrieval

Last synced: 30 Apr 2025

https://github.com/ducha-aiki/google-retrieval-challenge-2019-fastai-starter

fast.ai starter kit for Google Landmark Retrieval 2019 challenge

cnn fastai kaggle pytorch retrieval

Last synced: 30 Apr 2025

https://github.com/vitrivr/cineast

Cineast is a multi-feature content-based mulitmedia retrieval engine. It is capable of retrieving images, audio- and video sequences as well as 3d models based on edge or color sketches, textual descriptions and example objects.

3d audio images java oas retrieval video

Last synced: 11 Apr 2025

https://github.com/aimagelab/safe-clip

Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models. ECCV 2024

eccv2024 image-to-text nsfw retrieval safety text-to-image trustworthy-ai vision-and-language

Last synced: 11 Apr 2025

https://github.com/anush008/fastembed-go

Go implementation of @qdrant/fastembed.

embeddings rag retrieval retrieval-augmented-generation vector-search

Last synced: 16 Mar 2025

https://github.com/umbertogriffo/trie

A Mixed Trie and Levenshtein distance implementation in Java for extremely fast prefix string searching and string similarity.

data-structures java java-8 levenshtein-distance retrieval stream string-similarity trie

Last synced: 12 Jun 2025

https://github.com/orionw/followir

FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions

information instructions llm retrieval search

Last synced: 13 Apr 2025

https://github.com/vitrivr/cottontaildb

Cottontail DB is a column store vector database aimed at multimedia retrieval. It allows for classical boolean as well as vector-space retrieval (nearest neighbour search) used in similarity search using a unified data and query model.

cottontail-db cottontaildb database embedding-similarity knearest-neighbours-lookup multimedia multimedia-retrieval retrieval similarity-search vector-database vector-search-engine vector-space-retrieval

Last synced: 11 Jun 2025

https://github.com/palladian/palladian

Palladian is a Java-based toolkit with functionality for text processing, classification, information extraction, and data retrieval from the Web.

classification information-extraction retrieval text-mining

Last synced: 10 Jan 2026

https://github.com/lorenzhs/burr

Bumped Ribbon Retrieval and Approximate Membership Query

amq approximate-membership approximate-membership-query bloom-filter bloom-filter-alternative retrieval

Last synced: 22 Aug 2025

https://github.com/waltersimoncini/fungivision

Library implementation of "No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations"

computer-vision deep-learning retrieval self-supervised-learning

Last synced: 04 Sep 2025

https://github.com/zinengtang/perceiver_vl

PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)

efficiency retrieval scalability video-language vision-and-language

Last synced: 15 Jul 2025