Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/sobelio/llm-chain
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
https://github.com/sobelio/llm-chain
chatgpt langchain llama llm openai rust text-summary
Last synced: 4 days ago
JSON representation
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
- Host: GitHub
- URL: https://github.com/sobelio/llm-chain
- Owner: sobelio
- License: mit
- Created: 2023-03-24T23:53:13.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-31T16:19:00.000Z (2 months ago)
- Last Synced: 2024-12-31T11:04:35.487Z (11 days ago)
- Topics: chatgpt, langchain, llama, llm, openai, rust, text-summary
- Language: Rust
- Homepage: https://llm-chain.xyz
- Size: 4.8 MB
- Stars: 1,397
- Watchers: 19
- Forks: 134
- Open Issues: 38
-
Metadata Files:
- Readme: docs/README.md
- Contributing: docs/CONTRIBUTING.md
- License: LICENSE
- Code of conduct: docs/CODE_OF_CONDUCT.md
- Security: SECURITY.md
Awesome Lists containing this project
- awesome-langchain-zh - llm-chain - chain?style=social):一个强大的 rust 库，用于在 LLM 中构建链，让你能够总结文本和完成复杂任务。 (其他LLM框架 / 文章)
- awesome-ChatGPT-repositories - llm-chain - `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks (Langchain)
- awesome-langchain - llm-chain - chain?style=social) (Other LLM Frameworks / Videos Playlists)
- awesome-chatgpt - sobelio/llm-chain - `llm-chain` is a powerful Rust crate for building chains in large language models allowing you to summarise text and complete complex tasks (SDK, Libraries, Frameworks / Other sdk/libraries)
- awesome-llm-and-aigc - llm-chain - chain?style=social"/> : llm-chain is a collection of Rust crates designed to help you work with Large Language Models (LLMs) more effectively. [llm-chain.xyz](https://llm-chain.xyz/) (Summary)
- awesome-llm-and-aigc - llm-chain - chain?style=social"/> : llm-chain is a collection of Rust crates designed to help you work with Large Language Models (LLMs) more effectively. [llm-chain.xyz](https://llm-chain.xyz/) (Summary)
- awesome-cuda-triton-hpc - llm-chain - chain?style=social"/> : llm-chain is a collection of Rust crates designed to help you work with Large Language Models (LLMs) more effectively. [llm-chain.xyz](https://llm-chain.xyz/) (Frameworks)
- awesome-cuda-triton-hpc - llm-chain - chain?style=social"/> : llm-chain is a collection of Rust crates designed to help you work with Large Language Models (LLMs) more effectively. [llm-chain.xyz](https://llm-chain.xyz/) (Frameworks)
- awesome-rust-list - sobelio/llm-chain - chain?style=social"/> : llm-chain 🚀 is a collection of Rust crates designed to help you create advanced LLM applications such as chatbots, agents, and more. As a comprehensive LLM-Ops platform we have strong support for both cloud and locally-hosted LLMs. [llm-chain.xyz](https://llm-chain.xyz/) (Machine Learning)
- awesome-rust-list - sobelio/llm-chain - chain?style=social"/> : llm-chain 🚀 is a collection of Rust crates designed to help you create advanced LLM applications such as chatbots, agents, and more. As a comprehensive LLM-Ops platform we have strong support for both cloud and locally-hosted LLMs. [llm-chain.xyz](https://llm-chain.xyz/) (Machine Learning)
- awesome_ai_agents - Llm-Chain - `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks (Building / LLM Models)
- awesome_ai_agents - Llm-Chain - `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks (Building / LLM Models)
README
# llm-chain 🚀
`llm-chain` is a collection of Rust crates designed to help you create advanced LLM applications such as chatbots, agents, and more. As a comprehensive LLM-Ops platform we have strong support for both cloud and locally-hosted LLMs. We also provide robust support for prompt templates and chaining together prompts in multi-step chains, enabling complex tasks that LLMs can't handle in a single step. We also provide vector store integrations making it easy to give your model long-term memory and subject matter knowledge. This empowers you to build sophisticated applications.
[](https://discord.gg/kewN9Gtjt2)
[](https://crates.io/crates/llm-chain)
[](https://sobelio.github.io/llm-chain/docs/getting-started-tutorial/index)
## Examples 💡
To help you get started, here is an example demonstrating how to use `llm-chain`. You can find more examples in the [examples folder](/crates/llm-chain-openai/examples) in the repository.
```rust
let exec = executor!()?;
let res = prompt!(
"You are a robot assistant for making personalized greetings",
"Make a personalized greeting for Joe"
)
.run(parameters()!, &exec)
.await?;
println!("{}", res);
```
[➡️ **tutorial: get started with llm-chain**](https://sobelio.github.io/llm-chain/docs/getting-started-tutorial/index)
[➡️ **quick-start**: Create project based on our template](https://github.com/sobelio/llm-chain-template/generate)
## Features 🌟
- **Prompt templates**: Create reusable and easily customizable prompt templates for consistent and structured interactions with LLMs.
- **Chains**: Build powerful chains of prompts that allow you to execute more complex tasks, step by step, leveraging the full potential of LLMs.
- **ChatGPT support**: Supports ChatGPT models, with plans to add OpenAI's other models in the future.
- **LLaMa support**: Provides seamless integration with LLaMa models, enabling natural language understanding and generation tasks with Facebook's research models.
- **Alpaca support**: Incorporates support for Stanford's Alpaca models, expanding the range of available language models for advanced AI applications.
- **`llm.rs` support**: Use llms in rust without dependencies on C++ code with our support for `llm.rs`
- **Tools**: Enhance your AI agents' capabilities by giving them access to various tools, such as running Bash commands, executing Python scripts, or performing web searches, enabling more complex and powerful interactions.
- **Extensibility**: Designed with extensibility in mind, making it easy to integrate additional LLMs as the ecosystem grows.
- **Community-driven**: We welcome and encourage contributions from the community to help improve and expand the capabilities of `llm-chain`.
## Getting Started 🚀
To start using `llm-chain`, add it as a dependency in your `Cargo.toml` (you need Rust 1.65.0 or newer):
```toml
[dependencies]
llm-chain = "0.12.0"
llm-chain-openai = "0.12.0"
```
The examples for `llm-chain-openai` require you to set the `OPENAI_API_KEY` environment variable which you can do like this:
```bash
export OPENAI_API_KEY="sk-YOUR_OPEN_AI_KEY_HERE"
```
Then, refer to the [documentation](https://docs.rs/llm-chain) and [examples](/crates/llm-chain-openai/examples) to learn how to create prompt templates, chains, and more.
## Contributing 🤝
**We warmly welcome contributions from everyone!** If you're interested in helping improve `llm-chain`, please check out our [`CONTRIBUTING.md`](/docs/CONTRIBUTING.md) file for guidelines and best practices.
## License 📄
`llm-chain` is licensed under the [MIT License](/LICENSE).
## Connect with Us 🌐
If you have any questions, suggestions, or feedback, feel free to open an issue or join our [community discord](https://discord.gg/kewN9Gtjt2). We're always excited to hear from our users and learn about your experiences with `llm-chain`.
We hope you enjoy using `llm-chain` to unlock the full potential of Large Language Models in your projects. Happy coding! 🎉