{"id":13496999,"url":"https://github.com/sobelio/llm-chain","last_synced_at":"2025-05-13T18:07:17.191Z","repository":{"id":147481019,"uuid":"618644310","full_name":"sobelio/llm-chain","owner":"sobelio","description":"`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks","archived":false,"fork":false,"pushed_at":"2024-10-31T16:19:00.000Z","size":5034,"stargazers_count":1477,"open_issues_count":41,"forks_count":138,"subscribers_count":19,"default_branch":"main","last_synced_at":"2025-05-11T02:47:18.138Z","etag":null,"topics":["chatgpt","langchain","llama","llm","openai","rust","text-summary"],"latest_commit_sha":null,"homepage":"https://llm-chain.xyz","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sobelio.png","metadata":{"files":{"readme":"docs/README.md","changelog":null,"contributing":"docs/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"docs/CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-24T23:53:13.000Z","updated_at":"2025-05-08T12:25:23.000Z","dependencies_parsed_at":"2024-04-22T03:02:33.690Z","dependency_job_id":"e4b8b9e9-82e0-4cba-877d-c12e5fd52e1a","html_url":"https://github.com/sobelio/llm-chain","commit_stats":{"total_commits":344,"total_committers":41,"mean_commits":8.390243902439025,"dds":0.5087209302325582,"last_synced_commit":"5d26adf8fecdbc2ea5e4b233620fdf206bd36446"},"previous_names":[],"tags_count":121,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sobelio%2Fllm-chain","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sobelio%2Fllm-chain/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sobelio%2Fllm-chain/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sobelio%2Fllm-chain/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sobelio","download_url":"https://codeload.github.com/sobelio/llm-chain/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253692311,"owners_count":21948314,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chatgpt","langchain","llama","llm","openai","rust","text-summary"],"created_at":"2024-07-31T20:00:20.552Z","updated_at":"2025-05-13T18:07:17.166Z","avatar_url":"https://github.com/sobelio.png","language":"Rust","funding_links":[],"categories":["Models \u0026 Inference","Rust","Langchain","Summary","Frameworks","Building","其他LLM框架","Machine Learning","Other LLM Frameworks","SDK, Libraries, Frameworks","LLM Application Frameworks \u0026 Prompting Libraries","2. Libraries \u0026 Frameworks","Model Inference"],"sub_categories":["LLM Models","文章","Videos Playlists","Other sdk/libraries","Rust"],"readme":"# llm-chain 🚀\n\n`llm-chain` is a collection of Rust crates designed to help you create advanced LLM applications such as chatbots, agents, and more. As a comprehensive LLM-Ops platform we have strong support for both cloud and locally-hosted LLMs. We also provide robust support for prompt templates and chaining together prompts in multi-step chains, enabling complex tasks that LLMs can't handle in a single step. We also provide vector store integrations making it easy to give your model long-term memory and subject matter knowledge. This empowers you to build sophisticated applications.\n\n[![Discord](https://dcbadge.vercel.app/api/server/kewN9Gtjt2?style=for-the-badge)](https://discord.gg/kewN9Gtjt2)\n[![Crates.io](https://img.shields.io/crates/v/llm-chain?style=for-the-badge)](https://crates.io/crates/llm-chain)\n![License](https://img.shields.io/github/license/sobelio/llm-chain?style=for-the-badge)\n[![Docs: Tutorial](https://img.shields.io/badge/docs-tutorial-success?style=for-the-badge\u0026logo=appveyor)](https://sobelio.github.io/llm-chain/docs/getting-started-tutorial/index)\n\n## Examples 💡\n\nTo help you get started, here is an example demonstrating how to use `llm-chain`. You can find more examples in the [examples folder](/crates/llm-chain-openai/examples) in the repository.\n\n```rust\nlet exec = executor!()?;\nlet res = prompt!(\n    \"You are a robot assistant for making personalized greetings\",\n    \"Make a personalized greeting for Joe\"\n)\n.run(parameters()!, \u0026exec)\n.await?;\nprintln!(\"{}\", res);\n```\n\n[➡️ **tutorial: get started with llm-chain**](https://sobelio.github.io/llm-chain/docs/getting-started-tutorial/index)\n[➡️ **quick-start**: Create project based on our template](https://github.com/sobelio/llm-chain-template/generate)\n\n## Features 🌟\n\n- **Prompt templates**: Create reusable and easily customizable prompt templates for consistent and structured interactions with LLMs.\n- **Chains**: Build powerful chains of prompts that allow you to execute more complex tasks, step by step, leveraging the full potential of LLMs.\n- **ChatGPT support**: Supports ChatGPT models, with plans to add OpenAI's other models in the future.\n- **LLaMa support**: Provides seamless integration with LLaMa models, enabling natural language understanding and generation tasks with Facebook's research models.\n- **Alpaca support**: Incorporates support for Stanford's Alpaca models, expanding the range of available language models for advanced AI applications.\n- **`llm.rs` support**: Use llms in rust without dependencies on C++ code with our support for `llm.rs`\n- **Tools**: Enhance your AI agents' capabilities by giving them access to various tools, such as running Bash commands, executing Python scripts, or performing web searches, enabling more complex and powerful interactions.\n- **Extensibility**: Designed with extensibility in mind, making it easy to integrate additional LLMs as the ecosystem grows.\n- **Community-driven**: We welcome and encourage contributions from the community to help improve and expand the capabilities of `llm-chain`.\n\n## Getting Started 🚀\n\nTo start using `llm-chain`, add it as a dependency in your `Cargo.toml` (you need Rust 1.65.0 or newer):\n\n```toml\n[dependencies]\nllm-chain = \"0.12.0\"\nllm-chain-openai = \"0.12.0\"\n```\n\nThe examples for `llm-chain-openai` require you to set the `OPENAI_API_KEY` environment variable which you can do like this:\n\n```bash\nexport OPENAI_API_KEY=\"sk-YOUR_OPEN_AI_KEY_HERE\"\n```\n\nThen, refer to the [documentation](https://docs.rs/llm-chain) and [examples](/crates/llm-chain-openai/examples) to learn how to create prompt templates, chains, and more.\n\n## Contributing 🤝\n\n**We warmly welcome contributions from everyone!** If you're interested in helping improve `llm-chain`, please check out our [`CONTRIBUTING.md`](/docs/CONTRIBUTING.md) file for guidelines and best practices.\n\n## License 📄\n\n`llm-chain` is licensed under the [MIT License](/LICENSE).\n\n## Connect with Us 🌐\n\nIf you have any questions, suggestions, or feedback, feel free to open an issue or join our [community discord](https://discord.gg/kewN9Gtjt2). We're always excited to hear from our users and learn about your experiences with `llm-chain`.\n\nWe hope you enjoy using `llm-chain` to unlock the full potential of Large Language Models in your projects. Happy coding! 🎉\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsobelio%2Fllm-chain","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsobelio%2Fllm-chain","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsobelio%2Fllm-chain/lists"}