https://github.com/Yuan-ManX/ai-agent-toolkit
  
  
    Explore the latest AI Agent Framework! 
    https://github.com/Yuan-ManX/ai-agent-toolkit
  
agents ai-agents artificial-intelligence deep-learning deep-learning-framework framework mechine-learning
        Last synced: 5 days ago 
        JSON representation
    
Explore the latest AI Agent Framework!
- Host: GitHub
 - URL: https://github.com/Yuan-ManX/ai-agent-toolkit
 - Owner: Yuan-ManX
 - License: mit
 - Created: 2024-01-09T05:29:15.000Z (almost 2 years ago)
 - Default Branch: main
 - Last Pushed: 2024-05-28T11:53:57.000Z (over 1 year ago)
 - Last Synced: 2024-05-29T03:11:27.232Z (over 1 year ago)
 - Topics: agents, ai-agents, artificial-intelligence, deep-learning, deep-learning-framework, framework, mechine-learning
 - Homepage:
 - Size: 151 KB
 - Stars: 25
 - Watchers: 4
 - Forks: 2
 - Open Issues: 0
 - 
            Metadata Files:
            
- Readme: README.md
 - License: LICENSE
 
 
Awesome Lists containing this project
- Awesome-AI-Agents - ai-agent-roadmap - Explore the latest AI Agent Framework! (Reference Repo / Blog)
 - Awesome-AI-Agents - ai-agent-roadmap - Explore the latest AI Agent Framework! (Reference Repo / Blog)
 
README
          # AI Agent Toolkit
Here we will keep track of the latest AI Agent Toolkit, including AI Agent Framework, Memory, Tool, MCP, Prompt, Context Engineering, Code, Deep Research, Eval, Benchmark, Security, Monitor, Traces and Agent Reinforcement. 🎆
## Table of Contents
* [AI Agent Framework](#agent)
* [Memory](#memory)
* [Prompt & Context Engineering](#ce)
* [Mutimodel](#mm)
* [Browser & Web](#bw)
* [MCP & Tool](#tool)
* [Deep Research](#dr)
* [Code](#code)
* [Agent Reinforcement](#rl)
* [Eval & Benchmark](#eval)
* [Monitor & Traces](#mt)
* [Security](#sec)
## Project List
###  AI Agent Framework
| Source                                                                                      | Description                                                                                                                                                                                    |  Code  |   Paper   |
| :------------------------------------------------------------------------------------------ | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :-----------: | :-------: |
| [Adala](https://humansignal.github.io/Adala/)                             | Adala is an Autonomous DAta (Labeling) Agent framework.                                                                                                            | [GitHub](https://github.com/HumanSignal/Adala)                    |                                                   |
| [Agency](https://createwith.agency/)                                      | A fast and minimal framework for building agent-integrated systems.                                                                                                | [GitHub](https://github.com/operand/agency)                       |                                                   |
| [AgentBoard](https://github.com/hkust-nlp/AgentBoard)                     | An Analytical Evaluation Board of Multi-turn LLM Agents.                                                                                                           | [GitHub](https://github.com/hkust-nlp/AgentBoard)                 |                                                   |
| [Agent Group Chat](https://github.com/MikeGu721/AgentGroup)               | An Interactive Group Chat Simulacra For Better Eliciting Collective Emergent Behavior.                                                                             | [GitHub](https://github.com/MikeGu721/AgentGroup)                 | [arXiv](https://arxiv.org/abs/2403.13433)         |
| [Agent K](https://github.com/mikekelly/AgentK)                            | An autoagentic AGI that is self-evolving and modular.                                                                                                              | [GitHub](https://github.com/mikekelly/AgentK)                   |                                                   |
| [AgentKit](https://github.com/Holmeswww/AgentKit)                         | AgentKit: Flow Engineering with Graphs, not Coding.                                                                                                                | [GitHub](https://github.com/Holmeswww/AgentKit)                   |                                                   |
| [AgentKit](https://github.com/BCG-X-Official/agentkit)                    | AgentKit: rapidly build high quality Agent apps.                                                                                                                   | [GitHub](https://github.com/BCG-X-Official/agentkit)              |                                                   |
| [AgentLabs](https://www.agentlabs.dev/)                                   | Open-Source Universal AI Agent Frontend.                                                                                                                           | [GitHub](https://github.com/agentlabs-inc/agentlabs)              |                                                   |
| [Agent Protocol](https://agentprotocol.ai/)                               | Open interface for AI agent communication.                                                                                                                         | [GitHub](https://github.com/AI-Engineer-Foundation/agent-protocol)   |                                                   |
| [Agents](https://github.com/aiwaves-cn/agents)                            | An Open-source Framework for Autonomous Language Agents.                                                                                                           | [GitHub](https://github.com/aiwaves-cn/agents)                    | [arXiv](https://arxiv.org/abs/2309.07870)         |
| [AgentScope](https://github.com/modelscope/agentscope)                    | Start building LLM-empowered multi-agent applications in an easier way.                                                                                            | [GitHub](https://github.com/modelscope/agentscope)                |                                                   |
| [Agentsflow](https://github.com/jaemil/agentsflow)                        | Drag & drop UI to build and run a flow of autogen AI agents.                                                                                                       | [GitHub](https://github.com/jaemil/agentsflow)                    |                                                   |
| [agentUniverse](https://github.com/alipay/agentUniverse)                  | agentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications.                                                      | [GitHub](https://github.com/alipay/agentUniverse)                 |                                                   |
| [AgentVerse](https://github.com/OpenBMB/AgentVerse)                       | AgentVerse is designed to facilitate the deployment of multiple LLM-based agents in various applications.                                                          | [GitHub](https://github.com/OpenBMB/AgentVerse)                    | [arXiv](https://arxiv.org/abs/2308.10848)         |
| [AIOS](https://github.com/agiresearch/AIOS)                               | LLM Agent Operating System.                                                                                                                                        | [GitHub](https://github.com/agiresearch/AIOS)                      |                                                   |
| [Atomic Agents](https://github.com/KennyVaneetvelde/atomic_agents)    | The Atomic Agents framework is designed to be modular, extensible, and easy to use.                                                                                    | [GitHub](https://github.com/KennyVaneetvelde/atomic_agents)        |                                                   |
| [AutoAgents](https://github.com/Link-AGI/AutoAgents)                      | A Framework for Automatic Agent Generation.                                                                                                                        | [GitHub](https://github.com/Link-AGI/AutoAgents)                   | [arXiv](https://arxiv.org/abs/2309.17288)         |
| [AutoGen](https://microsoft.github.io/autogen/)                           | AutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks.                    | [GitHub](https://github.com/microsoft/autogen)                     | [arXiv](https://arxiv.org/abs/2308.08155)         |
| [AutoGPT](https://news.agpt.co/)                                          | Build & Use AI Agents.                                                                                                                                             | [GitHub](https://github.com/Significant-Gravitas/AutoGPT)          |                                                   |
| [Buffer of Thoughts](https://github.com/YangLing0818/buffer-of-thought-llm)         | Thought-Augmented Reasoning with Large Language Models.                                                                                                  | [GitHub](https://github.com/YangLing0818/buffer-of-thought-llm)          | [arXiv](https://arxiv.org/abs/2406.04271)         |
| [Byzer-Agent](https://github.com/allwefantasy/byzer-agent)                | Easy, fast, and distributed agent framework for everyone.                                                                                                          | [GitHub](https://github.com/allwefantasy/byzer-agent)              |                                                   |
| [CAMEL](https://www.camel-ai.org/)                                        | Communicative Agents for “Mind” Exploration of Large Scale Language Model Society.                                                                                 | [GitHub](https://github.com/camel-ai/camel)                        | [arXiv](https://arxiv.org/abs/2303.17760)         |
| [Character-LLM](https://github.com/choosewhatulike/trainable-agents)      | A Trainable Agent for Role-Playing.                                                                                                                                | [GitHub](https://github.com/choosewhatulike/trainable-agents)      | [arXiv](https://arxiv.org/abs/2310.10158)         |
| [ChatDev](https://github.com/OpenBMB/ChatDev)                             | Communicative Agents for Software Development.                                                                                                                     | [GitHub](https://github.com/OpenBMB/ChatDev)             |                                                   |
| [CogAgent](https://github.com/THUDM/CogVLM)                               | A Visual Language Model for GUI Agents.                                                                                                                            | [GitHub](https://github.com/THUDM/CogVLM)                | [arXiv](https://arxiv.org/abs/2312.08914)         |
| [crewAI](https://www.crewai.io/)                                          | Framework for orchestrating role-playing, autonomous AI agents.                                                                                                    | [GitHub](https://github.com/joaomdmoura/crewAI)          |                                                   |
| [DB-GPT](https://dbgpt.site/)                                             | DB-GPT is an open-source framework designed for the realm of large language models (LLMs) within the database field.                                             | [GitHub](https://github.com/eosphoros-ai/DB-GPT)         | [arXiv](https://arxiv.org/abs/2312.17449)         |
| [Dify](https://dify.ai/)                                                  | Dify is an open-source LLM app building platform.                                                                                                                  | [GitHub](https://github.com/langgenius/dify)             |                                                   |
| [Digital Life Project](https://digital-life-project.com/)                 | Autonomous 3D Characters with Social Intelligence.                                                                                                                 |                                                          | [arXiv](https://arxiv.org/abs/2312.04547)         |
| [DSPy](https://github.com/stanfordnlp/dspy)                               | DSPy is the framework for solving advanced tasks with language models (LMs) and retrieval models (RMs).                                                            | [GitHub](https://github.com/stanfordnlp/dspy)            | [arXiv](https://arxiv.org/abs/2310.03714)         |
| [everything-ai](https://github.com/AstraBert/everything-ai)               | Your fully proficient, AI-powered and local chatbot assistant🤖.                                                                                                  | [GitHub](https://github.com/AstraBert/everything-ai)                 |                                                   |
| [fabric](https://github.com/danielmiessler/fabric)                        | fabric is an open-source framework for augmenting humans using AI.                                                                                                 | [GitHub](https://github.com/danielmiessler/fabric)       |                                                   |
| [FastGPT](https://fastgpt.in/)                                            | FastGPT is a knowledge-based platform built on the LLM.                                                                                                            | [GitHub](https://github.com/labring/FastGPT)             |                                                   |
| [fastRAG](https://github.com/IntelLabs/fastRAG)                           | Efficient Retrieval Augmentation and Generation Framework.                                                                                                         | [GitHub](https://github.com/IntelLabs/fastRAG)           |                                                   |
| [Fine](https://www.fine.dev/)                                             | Automate software development with AI Agents.                                                                                                                      | [GitHub](https://github.com/finehq/fine)                 |                                                   |
| [Flowise](https://github.com/FlowiseAI/Flowise)                           | Build LLM Apps Easily.                                                                                                                                             | [GitHub](https://github.com/FlowiseAI/Flowise)           |                                                   |
| [GraphRAG](https://github.com/microsoft/graphrag)                         | A modular graph-based Retrieval-Augmented Generation (RAG) system.                                                                                                 | [GitHub](https://github.com/microsoft/graphrag)          |                                                   |
| [KwaiAgents](https://github.com/KwaiKEG/KwaiAgents)                       | A generalized information-seeking agent system with Large Language Models (LLMs).                                                                                  | [GitHub](https://github.com/KwaiKEG/KwaiAgents)          | [arXiv](https://arxiv.org/abs/2312.04889)         |
| [Lagent](https://github.com/InternLM/lagent)                              | A lightweight framework for building LLM-based agents.                                                                                                             | [GitHub](https://github.com/InternLM/lagent)             |                                                   |
| [LangChain](https://www.langchain.com/)                                   | Get your LLM application from prototype to production.                                                                                                             | [GitHub](https://github.com/langchain-ai/langchain)      |                                                   |
| [Langflow](https://www.langflow.org/)                                     | Langflow is a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.                                   | [GitHub](https://github.com/logspace-ai/langflow)        |                                                   |
| [LangGraph](https://github.com/langchain-ai/langgraph)                    | Building language agents as graphs.                                                                                                                                | [GitHub](https://github.com/langchain-ai/langgraph)      |                                                   |
| [LangGraph Studio](https://github.com/langchain-ai/langgraph-studio)      | LangGraph Studio offers a new way to develop LLM applications by providing a specialized agent IDE that enables visualization, interaction, and debugging of complex agentic applications.                                                                                                                                | [GitHub](https://github.com/langchain-ai/langgraph-studio)      |                                                   |
| [Langroid](https://langroid.github.io/langroid/)                          | Multi-Agent Framework.                                                                                                                                             | [GitHub](https://github.com/langroid/langroid)           |                                                   |
| [Lepton AI](https://www.lepton.ai/)                                       | A Pythonic framework to simplify AI service building.                                                                                                              | [GitHub](https://github.com/leptonai/leptonai)           |                                                   |
| [LlamaIndex](https://www.llamaindex.ai/)                                  | LlamaIndex is a simple, flexible data framework for connecting custom data sources to large language models.                                                       | [GitHub](https://github.com/run-llama/llama_index)       |                                                   |
| [LLMStack](https://llmstack.ai/)                                          | Open-source platform to build AI Agents, workflows and applications with your data.                                                                                | [GitHub](https://github.com/trypromptly/LLMStack)        |                                                   |
| [Marvin](https://www.askmarvin.ai/)                                       | The AI Engineering Framework.                                                                                                                                      | [GitHub](https://github.com/PrefectHQ/marvin)            |                                                   |
| [MetaGPT](https://www.deepwisdom.ai/)                                     | The Multi-Agent Framework.                                                                                                                                         | [GitHub](https://github.com/geekan/MetaGPT)              |                                                   |
| [MindSearch](https://github.com/InternLM/MindSearch)                                     | MindSearch: Mimicking Human Minds Elicits Deep AI Searcher.                                                                                         | [GitHub](https://github.com/InternLM/MindSearch)              |                                                   |
| [Mixture of Agents (MoA)](https://github.com/togethercomputer/MoA)        | Mixture-of-Agents Enhances Large Language Model Capabilities.                                                                                                      | [GitHub](https://github.com/togethercomputer/MoA)        | [arXiv](https://arxiv.org/abs/2406.04692)         |
| [Mobile-Agent](https://github.com/X-PLUG/MobileAgent)                     | Autonomous Multi-Modal Mobile Device Agent with Visual Perception.                                                                                                 | [GitHub](https://github.com/X-PLUG/MobileAgent)          | [arXiv](https://arxiv.org/abs/2401.16158)         |
| [Multi-LLM Agent](https://github.com/X-PLUG/Multi-LLM-Agent)              | α-UMi: Small LLMs Are Weak Tool Learners.                                                                                                                          | [GitHub](https://github.com/X-PLUG/Multi-LLM-Agent)      | [arXiv](https://arxiv.org/abs/2401.07324)         |
| [OpenAgents](https://github.com/xlang-ai/OpenAgents)                      | An Open Platform for Language Agents in the Wild.                                                                                                                  | [GitHub](https://github.com/xlang-ai/OpenAgents)         | [arXiv](https://arxiv.org/abs/2310.10634)         |
| [OpenGPTs](https://github.com/langchain-ai/opengpts)                      |  A framework for creating agent runtimes.                                                                                                                          | [GitHub](https://github.com/langchain-ai/opengpts)       |                                                   |
| [OpenPaL](https://github.com/opendilab/openPAL)                           | Building Open-Ended Embodied Agent via Language-Policy Bidirectional Adaptation.                                                                                   | [GitHub](https://github.com/opendilab/openPAL)           | [arXiv](https://arxiv.org/abs/2401.00006)         |
| [Phidata](https://github.com/phidatahq/phidata)                           |  Build AI Assistants using function calling.                                                                                                                       | [GitHub](https://github.com/phidatahq/phidata)           |                                                   |
| [Pipecat](https://github.com/pipecat-ai/pipecat)                          |  Open Source framework for voice and multimodal conversational AI.                                                                                                 | [GitHub](https://github.com/pipecat-ai/pipecat)          |                                                   |
| [PR-Agent](https://github.com/Codium-ai/pr-agent)                         |  An AI-Powered 🤖 Tool for Automated Pull Request Analysis, Feedback, Suggestions and More!                                                                       | [GitHub](https://github.com/Codium-ai/pr-agent)          |                                                   |
| [ProAgent](https://github.com/OpenBMB/ProAgent)                           | From Robotic Process Automation to Agentic Process Automation.                                                                                                     | [GitHub](https://github.com/OpenBMB/ProAgent)            | [arXiv](https://arxiv.org/abs/2311.10751)         |
| [Qwen-Agent](https://github.com/QwenLM/Qwen-Agent)                        | Qwen-Agent is a framework for developing LLM applications based on the instruction following, tool usage, planning, and memory capabilities of Qwen.         | [GitHub](https://github.com/QwenLM/Qwen-Agent)           |                                                   |
| [Ragas](https://docs.ragas.io/en/stable/)                                 | Ragas is a framework that helps you evaluate your Retrieval Augmented Generation (RAG) pipelines.                                                                  | [GitHub](https://github.com/explodinggradients/ragas)    |                                                   |
| [RAGoon](https://github.com/louisbrulenaudet/ragoon)                      | Improve Large Language Models retrieval using dynamic web-search ⚡.                                                                                              | [GitHub](https://github.com/louisbrulenaudet/ragoon)    |                                                   |
| [ReWOO](https://github.com/billxbf/ReWOO)                                 | Decoupling Reasoning from Observations for Efficient Augmented Language Models.                                                                                    | [GitHub](https://github.com/billxbf/ReWOO)               |                                                   |
| [Search with Lepton](https://github.com/leptonai/search_with_lepton)      | Building a quick conversation-based search demo with Lepton AI.                                                                                                    | [GitHub](https://github.com/leptonai/search_with_lepton) |                                                   |
| [Superagent](https://docs.superagent.sh/)                                 | The open framework for building AI Assistants.                                                                                                                     | [GitHub](https://github.com/homanp/superagent)           |                                                   |
| [SuperAGI](https://superagi.com/)                                         | SuperAGI - A dev-first open source autonomous AI agent framework.                                                                                                  | [GitHub](https://github.com/TransformerOptimus/SuperAGI) |                                                   |
| [SWE-agent](https://swe-agent.com/)                                       | Agent Computer Interfaces Enable Software Engineering Language Models.                                                                                             | [GitHub](https://github.com/princeton-nlp/SWE-agent)     |                                                   |
| [TaskGen](https://github.com/simbianai/taskgen)                           | A Task-based agentic framework building on StrictJSON outputs by LLM agents.                                                                                       | [GitHub](https://github.com/simbianai/taskgen)         |                                                   |
| [TaskingAI](https://www.tasking.ai/)                                      | The open source platform for AI-native application development.                                                                                                    | [GitHub](https://github.com/TaskingAI/TaskingAI)         |                                                   |
| [TaskWeaver](https://microsoft.github.io/TaskWeaver/)                     | A Code-First Agent Framework.                                                                                                                                      | [GitHub](https://github.com/microsoft/TaskWeaver)        | [arXiv](https://arxiv.org/abs/2311.17541)         |
| [ToRA](https://github.com/microsoft/ToRA)                                 | ToRA: A Tool-Integrated Reasoning Agent.                                                                                                                           | [GitHub](https://github.com/microsoft/ToRA)              | [arXiv](https://arxiv.org/abs/2309.17452)         |
| [Translation Agent](https://github.com/andrewyng/translation-agent)       | Agentic translation using reflection workflow.                                                                                                                     | [GitHub](https://github.com/andrewyng/translation-agent)               |                                                   |
| [UFO](https://github.com/microsoft/UFO)                                   | A UI-Focused Agent for Windows OS Interaction.                                                                                                                     | [GitHub](https://github.com/microsoft/UFO)               |                                                   |
| [Vanna](https://vanna.ai/)                                                | Vanna helps you generate and run accurate SQL for your database using LLMs via Retrieval-Augmented Generation.                                                     | [GitHub](https://github.com/vanna-ai/vanna)              |                                                   |
| [WebDesignAgent](https://github.com/DAMO-NLP-SG/WebDesignAgent)                                       | An agent used for webdesign.                                                                                                           | [GitHub](https://github.com/DAMO-NLP-SG/WebDesignAgent)              |                                                   |
| [XAgent](https://blog.x-agent.net/)                                       | An Autonomous Agent for Complex Task Solving.                                                                                                                      | [GitHub](https://github.com/OpenBMB/XAgent)              |                                                   |
| [X-Force IDE](https://ide.x-force.ai/)                                    | X-Force IDE is a low-code, agent-as-a-service UI framework.                                                                                                        | [GitHub](https://github.com/xforceai/ide)                |                                                   |
###  Memory
| Source                                                                                      | Description                                                                                                                                                                                    |  Code  |   Paper   |
| :------------------------------------------------------------------------------------------ | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :-----------: | :-------: |
| [Chroma](https://www.trychroma.com/)                             | Chroma - the AI-native open-source embedding database.                                                                                                                 | [GitHub](https://github.com/chroma-core/chroma)                    |                                                   |
| [LanceDB](https://lancedb.com/)                                  | LanceDB is a developer-friendly, open source database for AI.                                                                                                                 | [GitHub](https://github.com/lancedb/lancedb)                    |                                                   |
| [Milvus](https://milvus.io/)                                     | A cloud-native vector database, storage for next generation AI applications.                                                                                           | [GitHub](https://github.com/milvus-io/milvus)                    |                                                   |
| [Pinecone](https://www.pinecone.io/)                             | Pinecone serverless lets you deliver remarkable GenAI applications faster, at up to 50x lower cost.                                                                                           |                   |                                                   |
| [Weaviate](https://weaviate.io/)                                 | The AI-native database for a new generation of software.                                                                                         | [GitHub](https://github.com/weaviate/weaviate)                    |                                                   |
###  Prompt & Context Engineering
| Source                                                                                      | Description                                                                                                                                                                                    |  Code  |   Paper   |
| :------------------------------------------------------------------------------------------ | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :-----------: | :-------: |
| [DSPy](https://dspy.ai/)                                 | DSPy: The framework for programming—not prompting—language models.                                                                                         | [GitHub](https://github.com/stanfordnlp/dspy)                    |                                                   |
###  Security
| Source                                                                                      | Description                                                                                                                                                                                    |  Code  |   Paper   |
| :------------------------------------------------------------------------------------------ | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :-----------: | :-------: |
| [E2B](https://e2b.dev/docs)                                               | Cloud Runtime for AI Agents.                                                                                                                                       | [GitHub](https://github.com/e2b-dev/E2B)                 |                                                   |