{"id":14579306,"url":"https://github.com/run-llama/llama_deploy","last_synced_at":"2025-06-23T10:07:35.890Z","repository":{"id":246258708,"uuid":"807727161","full_name":"run-llama/llama_deploy","owner":"run-llama","description":"Deploy your agentic worfklows to production","archived":false,"fork":false,"pushed_at":"2025-06-20T07:48:59.000Z","size":7439,"stargazers_count":2027,"open_issues_count":20,"forks_count":228,"subscribers_count":24,"default_branch":"main","last_synced_at":"2025-06-20T08:39:11.005Z","etag":null,"topics":["agents","deployment","framework","llamaindex","llm","multi-agents"],"latest_commit_sha":null,"homepage":"https://docs.llamaindex.ai/en/stable/module_guides/llama_deploy/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/run-llama.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-05-29T16:52:16.000Z","updated_at":"2025-06-20T07:49:01.000Z","dependencies_parsed_at":"2024-06-26T22:48:15.118Z","dependency_job_id":"ad2fad99-e4d7-42d8-9935-a5648d9699f6","html_url":"https://github.com/run-llama/llama_deploy","commit_stats":null,"previous_names":["run-llama/llama-agents"],"tags_count":44,"template":false,"template_full_name":null,"purl":"pkg:github/run-llama/llama_deploy","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/run-llama%2Fllama_deploy","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/run-llama%2Fllama_deploy/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/run-llama%2Fllama_deploy/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/run-llama%2Fllama_deploy/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/run-llama","download_url":"https://codeload.github.com/run-llama/llama_deploy/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/run-llama%2Fllama_deploy/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260976702,"owners_count":23091506,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agents","deployment","framework","llamaindex","llm","multi-agents"],"created_at":"2024-09-07T20:01:19.705Z","updated_at":"2025-06-23T10:07:30.875Z","avatar_url":"https://github.com/run-llama.png","language":"Python","readme":"[![PyPI - Version](https://img.shields.io/pypi/v/llama-deploy.svg)](https://pypi.org/project/llama-deploy)\n[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/llama-deploy.svg)](https://pypi.org/project/llama-deploy)\n[![Static Badge](https://img.shields.io/badge/docs-latest-blue)](https://docs.llamaindex.ai/en/latest/module_guides/llama_deploy/)\n\n\n[![Unit Testing](https://github.com/run-llama/llama_deploy/actions/workflows/unit_test.yml/badge.svg)](https://github.com/run-llama/llama_deploy/actions/workflows/unit_test.yml)\n[![E2E Testing](https://github.com/run-llama/llama_deploy/actions/workflows/e2e_test.yml/badge.svg)](https://github.com/run-llama/llama_deploy/actions/workflows/e2e_test.yml)\n[![Coverage Status](https://coveralls.io/repos/github/run-llama/llama_deploy/badge.svg?branch=main)](https://coveralls.io/github/run-llama/llama_deploy?branch=main)\n\n\n# 🦙 LlamaDeploy 🤖\n\nLlamaDeploy (formerly `llama-agents`) is an async-first framework for deploying, scaling, and productionizing agentic\nmulti-service systems based on [workflows from `llama_index`](https://docs.llamaindex.ai/en/stable/understanding/workflows/).\nWith LlamaDeploy, you can build any number of workflows in `llama_index` and then run them as services, accessible\nthrough a HTTP API by a user interface or other services part of your system.\n\nThe goal of LlamaDeploy is to easily transition something that you built in a notebook to something running on the\ncloud with the minimum amount of changes to the original code, possibly zero. In order to make this transition a\npleasant one, you can interact with LlamaDeploy in two ways:\n\n- Using the [`llamactl`](https://docs.llamaindex.ai/en/latest/module_guides/llama_deploy/50_llamactl/) CLI from a shell.\n- Through the [_LlamaDeploy SDK_](https://docs.llamaindex.ai/en/latest/module_guides/llama_deploy/40_python_sdk/) from a Python application or script.\n\nBoth the SDK and the CLI are part of the LlamaDeploy Python package. To install, just run:\n\n```bash\npip install llama_deploy\n```\n\u003e [!TIP]\n\u003e For a comprehensive guide to LlamaDeploy's architecture and detailed descriptions of its components, visit our\n[official documentation](https://docs.llamaindex.ai/en/latest/module_guides/llama_deploy/).\n\n## Why LlamaDeploy?\n\n1. **Seamless Deployment**: It bridges the gap between development and production, allowing you to deploy `llama_index`\n   workflows with minimal changes to your code.\n2. **Scalability**: The microservices architecture enables easy scaling of individual components as your system grows.\n3. **Flexibility**: By using a hub-and-spoke architecture, you can easily swap out components (like message queues) or\n   add new services without disrupting the entire system.\n4. **Fault Tolerance**: With built-in retry mechanisms and failure handling, LlamaDeploy adds robustness in\n   production environments.\n5. **State Management**: The control plane manages state across services, simplifying complex multi-step processes.\n6. **Async-First**: Designed for high-concurrency scenarios, making it suitable for real-time and high-throughput\n   applications.\n\n\u003e [!NOTE]\n\u003e This project was initially released under the name `llama-agents`,  but the introduction of [Workflows](https://docs.llamaindex.ai/en/stable/module_guides/workflow/#workflows) in `llama_index` turned out to be the most intuitive way for our users to develop agentic applications. We then decided to add new agentic features in `llama_index` directly, and focus LlamaDeploy on closing the gap between local development and remote execution of agents as services.\n\n## Getting Started\n\nThe fastest way to start using LlamaDeploy is playing with a practical example. This repository contains a few applications you can use as a reference:\n\n- [Quick start](examples/quick_start)\n- [Use a deployment from a web-based user interface](examples/python_fullstack)\n- [Message queue examples](examples/message-queue-integrations)\n\nWe recommend to start from the [Quick start](examples/quick_start) example and move\nto [Use a deployment from a web-based user interface](examples/python_fullstack)\nimmediately after. Each folder contains a README file that will guide you through\nthe process.\n","funding_links":[],"categories":["Python","A01_文本生成_文本对话","Agent Integration \u0026 Deployment Tools"],"sub_categories":["大语言对话模型及数据","Stateful Serverless Frameworks"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frun-llama%2Fllama_deploy","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frun-llama%2Fllama_deploy","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frun-llama%2Fllama_deploy/lists"}