https://github.com/0xPlaygrounds/rig
⚙️🦀 Build portable, modular & lightweight Fullstack Agents
https://github.com/0xPlaygrounds/rig
agent ai artificial-intelligence automation large-language-model llm rust scalable-ai
Last synced: 3 months ago
JSON representation
⚙️🦀 Build portable, modular & lightweight Fullstack Agents
- Host: GitHub
- URL: https://github.com/0xPlaygrounds/rig
- Owner: 0xPlaygrounds
- License: mit
- Created: 2024-06-05T13:42:28.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-11-11T16:36:25.000Z (about 1 year ago)
- Last Synced: 2024-11-12T09:12:31.724Z (about 1 year ago)
- Topics: agent, ai, artificial-intelligence, automation, large-language-model, llm, rust, scalable-ai
- Language: Rust
- Homepage: https://rig.rs
- Size: 10.1 MB
- Stars: 153
- Watchers: 6
- Forks: 9
- Open Issues: 22
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome-hacking-lists - 0xPlaygrounds/rig - ⚙️🦀 Build portable, modular & lightweight Fullstack Agents (Rust)
- awesome-web3-ai - Rig
- StarryDivineSky - 0xPlaygrounds/rig - core`引入，使用示例包括创建OpenAI客户端并使用gpt-4模型进行prompt。 (A01_文本生成_文本对话 / 大语言对话模型及数据)
- awesome-ccamel - 0xPlaygrounds/rig - ⚙️🦀 Build modular and scalable LLM Applications in Rust (Rust)
- awesome - 0xPlaygrounds/rig - ⚙️🦀 Build modular and scalable LLM Applications in Rust (Rust)
README
 
[📑 Docs](https://docs.rig.rs)
•
[🌐 Website](https://rig.rs)
•
[🤝 Contribute](https://github.com/0xPlaygrounds/rig/issues/new)
•
[✍🏽 Blogs](https://docs.rig.rs/guides)
✨ If you would like to help spread the word about Rig, please consider starring the repo!
> [!WARNING]
> Here be dragons! As we plan to ship a torrent of features in the following months, future updates **will** contain **breaking changes**. With Rig evolving, we'll annotate changes and highlight migration paths as we encounter them.
## Table of contents
- [Table of contents](#table-of-contents)
- [What is Rig?](#what-is-rig)
- [High-level features](#high-level-features)
- [Who's using Rig in production?](#who-is-using-rig-in-production)
- [Get Started](#get-started)
- [Simple example:](#simple-example)
- [Integrations](#integrations)
## What is Rig?
Rig is a Rust library for building scalable, modular, and ergonomic **LLM-powered** applications.
More information about this crate can be found in the [official](https://docs.rig.rs) & [crate](https://docs.rs/rig-core/latest/rig/) (API Reference) documentations.
## High-level features
- Full support for LLM completion and embedding workflows
- Simple but powerful common abstractions over LLM providers (e.g. OpenAI, Cohere) and vector stores (e.g. MongoDB, SQlite, in-memory)
- Integrate LLMs in your app with minimal boilerplate
## Who is using Rig in production?
Below is a non-exhaustive list of companies and people who are using Rig in production:
- [Dria Compute Node](https://github.com/firstbatchxyz/dkn-compute-node) - a node that serves computation results within the Dria Knowledge Network
- [The MCP Rust SDK](https://github.com/modelcontextprotocol/rust-sdk ) - the official Model Context Protocol Rust SDK. Has an example for usage with Rig.
- [Probe](https://github.com/buger/probe) - an AI-friendly, fully local semantic code search tool.
- [NINE](https://github.com/NethermindEth/nine) - Neural Interconnected Nodes Engine, by [Nethermind.](https://www.nethermind.io/)
- [rig-onchain-kit](https://github.com/0xPlaygrounds/rig-onchain-kit) - the Rig Onchain Kit. Intended to make interactions between Solana/EVM and Rig much easier to implement.
- [Linera Protocol](https://github.com/linera-io/linera-protocol) - Decentralized blockchain infrastructure designed for highly scalable, secure, low-latency Web3 applications.
- [Listen](https://github.com/piotrostr/listen) - A framework aiming to become the go-to framework for AI portfolio management agents. Powers [the Listen app.](https://app.listen-rs.com/)
Are you also using Rig in production? [Open an issue](https://www.github.com/0xPlaygrounds/rig/issues) to have your name added!
## Get Started
```bash
cargo add rig-core
```
### Simple example:
```rust
use rig::{completion::Prompt, providers::openai};
#[tokio::main]
async fn main() {
// Create OpenAI client and model
// This requires the `OPENAI_API_KEY` environment variable to be set.
let openai_client = openai::Client::from_env();
let gpt4 = openai_client.agent("gpt-4").build();
// Prompt the model and print its response
let response = gpt4
.prompt("Who are you?")
.await
.expect("Failed to prompt GPT-4");
println!("GPT-4: {response}");
}
```
Note using `#[tokio::main]` requires you enable tokio's `macros` and `rt-multi-thread` features
or just `full` to enable all features (`cargo add tokio --features macros,rt-multi-thread`).
You can find more examples each crate's `examples` (ie. [`rig-core/examples`](./rig-core/examples)) directory. More detailed use cases walkthroughs are regularly published on our [Dev.to Blog](https://dev.to/0thtachi) and added to Rig's official documentation [(docs.rig.rs)](http://docs.rig.rs).
## Supported Integrations
Vector stores are available as separate companion-crates:
- MongoDB: [`rig-mongodb`](https://github.com/0xPlaygrounds/rig/tree/main/rig-mongodb)
- LanceDB: [`rig-lancedb`](https://github.com/0xPlaygrounds/rig/tree/main/rig-lancedb)
- Neo4j: [`rig-neo4j`](https://github.com/0xPlaygrounds/rig/tree/main/rig-neo4j)
- Qdrant: [`rig-qdrant`](https://github.com/0xPlaygrounds/rig/tree/main/rig-qdrant)
- SQLite: [`rig-sqlite`](https://github.com/0xPlaygrounds/rig/tree/main/rig-sqlite)
- SurrealDB: [`rig-surrealdb`](https://github.com/0xPlaygrounds/rig/tree/main/rig-surrealdb)
- Milvus: [`rig-milvus`](https://github.com/0xPlaygrounds/rig/tree/main/rig-milvus)
- ScyllaDB: [`rig-scylladb`](https://github.com/0xPlaygrounds/rig/tree/main/rig-scylladb)
- AWS S3Vectors: [`rig-s3vectors`](https://github.com/0xPlaygrounds/rig/tree/main/rig-s3vectors)
The following providers are available as separate companion-crates:
- Fastembed: [`rig-fastembed`](https://github.com/0xPlaygrounds/rig/tree/main/rig-fastembed)
- Eternal AI: [`rig-eternalai`](https://github.com/0xPlaygrounds/rig/tree/main/rig-eternalai)
