Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/sciphi-ai/r2r

The framework for fast development and deployment of RAG backends.
https://github.com/sciphi-ai/r2r

artificial-intelligence chatbot data-pipelines deep-learning langchain large-language-models llama-index llm machine-learning ocr pdf question-answering retrieval retrieval-augmented-generation retrieval-systems search

Last synced: 2 days ago
JSON representation

The framework for fast development and deployment of RAG backends.

Awesome Lists containing this project

README

        


Docs
Discord
Github Stars
Commits-per-week
License: MIT
Gurubase: R2R Guru

r2r


Build, scale, and deploy state of the art Retrieval-Augmented Generation applications.

# About
R2R (RAG to Riches), the Elasticsearch for RAG, bridges the gap between experimenting with and deploying state of the art Retrieval-Augmented Generation (RAG) applications. It's a complete platform that helps you quickly build and launch scalable RAG solutions. Built around a containerized [RESTful API](https://r2r-docs.sciphi.ai/api-reference/introduction), R2R offers multimodal ingestion support, hybrid search, GraphRAG capabilities, user management, and observability features.

For a more complete view of R2R, check out the [full documentation](https://r2r-docs.sciphi.ai/).

## Key Features
- [**๐Ÿ“ Multimodal Ingestion**](https://r2r-docs.sciphi.ai/documentation/configuration/ingestion/overview): Parse `.txt`, `.pdf`, `.json`, `.png`, `.mp3`, and more.
- [**๐Ÿ” Hybrid Search**](https://r2r-docs.sciphi.ai/cookbooks/hybrid-search): Combine semantic and keyword search with reciprocal rank fusion for enhanced relevancy.
- [**๐Ÿ”— Graph RAG**](https://r2r-docs.sciphi.ai/cookbooks/graphrag): Automatically extract relationships and build knowledge graphs.
- [**๐Ÿ—‚๏ธ App Management**](https://r2r-docs.sciphi.ai/cookbooks/user-auth): Efficiently manage documents and users with full authentication.
- [**๐Ÿ”ญ Observability**](https://r2r-docs.sciphi.ai/cookbooks/observability): Observe and analyze your RAG engine performance.
- [**๐Ÿงฉ Configurable**](https://r2r-docs.sciphi.ai/documentation/configuration/introduction): Provision your application using intuitive configuration files.
- [**๐Ÿ–ฅ๏ธ Dashboard**](https://github.com/SciPhi-AI/R2R-Dashboard): An open-source React+Next.js app with optional authentication, to interact with R2R via GUI.

## [What's New](https://r2r-docs.sciphi.ai/introduction/whats-new)

- Release 3.1.0ย ย ย ย September 6, 2024ย ย ย ย 

Warning: These changes are breaking! We will be releasing a migration script soon.
- Orchestration with [Hatchet](https://github.com/hatchet-dev/hatchet)
- Default ingestion provider set to [Unstructured](https://docs.unstructured.io/welcome)
- Improved knowledge graph construction process

## Install with pip
The recommended way to get started with R2R is by using our CLI.

```bash
pip install r2r
```

You may run R2R directly from the python package, but additional dependencies like Postgres+pgvector must be configured and the full R2R core is required:

```bash
# export OPENAI_API_KEY=sk-...
# export POSTGRES...
pip install 'r2r[core,ingestion-bundle]'
r2r --config-name=default serve
```

Alternatively, R2R can be launched alongside its requirements inside Docker:

```bash
# export OPENAI_API_KEY=sk-...
r2r serve --docker --full
```

The command above will install the `full` installation which includes Hatchet for orchestration and Unstructured.io for parsing.

## Getting Started

- [Installation](https://r2r-docs.sciphi.ai/documentation/installation): Quick installation of R2R using Docker or pip
- [Quickstart](https://r2r-docs.sciphi.ai/documentation/quickstart): A quick introduction to R2R's core features

## API & SDKs

- [SDK](https://r2r-docs.sciphi.ai/documentation/python-sdk): API reference and Python/JS SDKs for interacting with R2R
- [API](https://r2r-docs.sciphi.ai/api-reference/introduction): API reference and Python/JS SDKs for interacting with R2R
- [Configuration](https://r2r-docs.sciphi.ai/documentation/configuration/introduction): A guide on how to configure your R2R system

## Cookbooks

- Advanced RAG Pipelines
- [RAG Agent](https://r2r-docs.sciphi.ai/cookbooks/agent): R2R's powerful RAG agent
- [Hybrid Search](https://r2r-docs.sciphi.ai/cookbooks/hybrid-search): Introduction to hybrid search
- [Advanced RAG](https://r2r-docs.sciphi.ai/cookbooks/advanced-rag): Advanced RAG features

- Knowledge Graphs
- [GraphRAG](https://r2r-docs.sciphi.ai/cookbooks/graphrag): Walkthrough of GraphRAG

- Auth & Admin Features
- [Web Development](https://r2r-docs.sciphi.ai/cookbooks/web-dev): Building webapps using R2R
- [User Auth](https://r2r-docs.sciphi.ai/cookbooks/user-auth): Authenticating users
- [Collections](https://r2r-docs.sciphi.ai/cookbooks/collections): Document collections
- [Analytics & Observability](https://r2r-docs.sciphi.ai/cookbooks/observability): End-to-end logging and analytics
- [Web Application](https://r2r-docs.sciphi.ai/cookbooks/application): Connecting with the R2R Application

## Community

[Join our Discord server](https://discord.gg/p6KqD2kjtB) to get support and connect with both the R2R team and other developers in the community. Whether you're encountering issues, looking for advice on best practices, or just want to share your experiences, we're here to help.

# Contributing

We welcome contributions of all sizes! Here's how you can help:

- Open a PR for new features, improvements, or better documentation.
- Submit a [feature request](https://github.com/SciPhi-AI/R2R/issues/new?assignees=&labels=&projects=&template=feature_request.md&title=) or [bug report](https://github.com/SciPhi-AI/R2R/issues/new?assignees=&labels=&projects=&template=bug_report.md&title=)

### Our Contributors