Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/camel-ai/camel

🐫 CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org
https://github.com/camel-ai/camel

agent ai-societies artificial-intelligence communicative-ai cooperative-ai deep-learning large-language-models multi-agent-systems natural-language-processing

Last synced: 4 days ago
JSON representation

🐫 CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org

Awesome Lists containing this project

README 

        
[![Colab][colab-image]][colab-url]

[![Hugging Face][huggingface-image]][huggingface-url]

[![Slack][slack-image]][slack-url]

[![Discord][discord-image]][discord-url]

[![Wechat][wechat-image]][wechat-url]

[![Twitter][twitter-image]][twitter-url]



______________________________________________________________________



# CAMEL: Finding the Scaling Laws of Agents



[![Python Version][python-image]][python-url]

[![PyTest Status][pytest-image]][pytest-url]

[![Documentation][docs-image]][docs-url]

[![Star][star-image]][star-url]

[![Package License][package-license-image]][package-license-url]





  Community |

  Installation |

  Documentation |

  Examples |

  Paper |

  Citation |

  Contributing |

  CAMEL-AI






  




## Community

🐫 CAMEL is an open-source community dedicated to finding the scaling laws of agents. We believe that studying these agents on a large scale offers valuable insights into their behaviors, capabilities, and potential risks. To facilitate research in this field, we implement and support various types of agents, tasks, prompts, models, and simulated environments.



Join us ([*Discord*](https://discord.camel-ai.org/), [*WeChat*](https://ghli.org/camel/wechat.png) or [*Slack*](https://join.slack.com/t/camel-ai/shared_invite/zt-2g7xc41gy-_7rcrNNAArIP6sLQqldkqQ)) in pushing the boundaries of finding the scaling laws of agents.



## What Can You Build With CAMEL?



### πŸ€– Customize Agents

- Customizable agents are the fundamental entities of the CAMEL architecture. CAMEL empowers you to customize agents using our modular components for specific tasks.



### βš™οΈ Build Multi-Agent Systems

- We propose a multi-agent framework to address agents' autonomous cooperation challenges, guiding agents toward task completion while maintaining human intentions.



### πŸ’» Practical Applications

- The CAMEL framework serves as a generic infrastructure for a wide range of multi-agent applications, including task automation, data generation, and world simulations.



## Why Should You Use CAMEL?



1. Comprehensive Customization and Collaboration:



    - Integrates over 20 advanced model platforms (e.g., commercial models like OpenAI, open-source models such as Llama3, and self-deployment frameworks like Ollama.).



    - Supports extensive external tools (e.g., Search, Twitter, Github, Google Maps, Reddit, Slack utilities).

    - Includes memory and prompt components for deep customization.

    - Facilitates complex multi-agent systems with advanced collaboration features.



2. User-Friendly with Transparent Internal Structure:

    - Designed for transparency and consistency in internal structure.



    - Offers comprehensive [tutorials and detailed docstrings](https://docs.camel-ai.org/) for all functions.

    - Ensures an approachable learning curve for newcomers.



## Try It Yourself

We provide a [![Google Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1AzP33O8rnMW__7ocWJhVBXjKziJXPtim?usp=sharing) demo showcasing a conversation between two ChatGPT agents playing roles as a python programmer and a stock trader collaborating on developing a trading bot for stock market.





  




## Installation



### From PyPI



To install the base CAMEL library:

```bash

pip install camel-ai

```

Some features require extra dependencies:

- To install with all dependencies:

    ```bash

    pip install 'camel-ai[all]'

    ```

- To use the HuggingFace agents:

    ```bash

    pip install 'camel-ai[huggingface-agent]'

    ```

- To enable RAG or use agent memory:

    ```bash

    pip install 'camel-ai[tools]'

    ```



### From Source



Install `CAMEL` from source with poetry (Recommended):

```sh

# Make sure your python version is later than 3.10

# You can use pyenv to manage multiple python versions in your system



# Clone github repo

git clone https://github.com/camel-ai/camel.git



# Change directory into project directory

cd camel



# If you didn't install poetry before

pip install poetry  # (Optional)



# We suggest using python 3.10

poetry env use python3.10  # (Optional)



# Activate CAMEL virtual environment

poetry shell



# Install the base CAMEL library

# It takes about 90 seconds

poetry install



# Install CAMEL with all dependencies

poetry install -E all # (Optional)



# Exit the virtual environment

exit

```



> [!TIP]

> If you encounter errors when running `poetry install`, it may be due to a cache-related problem. You can try running:

> ```sh

> poetry install --no-cache

> ```



Install `CAMEL` from source with conda and pip:

```sh

# Create a conda virtual environment

conda create --name camel python=3.10



# Activate CAMEL conda environment

conda activate camel



# Clone github repo

git clone -b v0.2.11 https://github.com/camel-ai/camel.git



# Change directory into project directory

cd camel



# Install CAMEL from source

pip install -e .



# Or if you want to use all other extra packages

pip install -e .[all] # (Optional)

```



### From Docker



Detailed guidance can be find [here](https://github.com/camel-ai/camel/blob/master/.container/README.md)



## Quick Start



By default, the agent uses the `ModelType.DEFAULT` model from the `ModelPlatformType.DEFAULT`. You can configure the default model platform and model type using environment variables. If these are not set, the agent will fall back to the default settings:



```bash

ModelPlatformType.DEFAULT = "openai"

ModelType.DEFAULT = "gpt-4o-mini"

```



### Setting Default Model Platform and Model Type (Optional)



You can customize the default model platform and model type by setting the following environment variables:

```bash

export DEFAULT_MODEL_PLATFORM_TYPE=  # e.g., openai, anthropic, etc.

export DEFAULT_MODEL_TYPE=  # e.g., gpt-3.5-turbo, gpt-4o-mini, etc.

```



### Setting Your Model API Key (Using OpenAI as an Example)



**For Bash shell (Linux, macOS, Git Bash on Windows):**



```bash

# Export your OpenAI API key

export OPENAI_API_KEY=

OPENAI_API_BASE_URL=  #(Should you utilize an OpenAI proxy service, kindly specify this)

```



**For Windows Command Prompt:**



```cmd

REM export your OpenAI API key

set OPENAI_API_KEY=

set OPENAI_API_BASE_URL=  #(Should you utilize an OpenAI proxy service, kindly specify this)

```



**For Windows PowerShell:**



```powershell

# Export your OpenAI API key

$env:OPENAI_API_KEY=""

$env:OPENAI_API_BASE_URL=""  #(Should you utilize an OpenAI proxy service, kindly specify this)

```



Replace `` with your actual OpenAI API key in each case. Make sure there are no spaces around the `=` sign.



Please note that the environment variable is session-specific. If you open a new terminal window or tab, you will need to set the API key again in that new session.



**For `.env` File:**



To simplify the process of managing API Keys, you can use store information in a `.env` file and load them into your application dynamically.



1. Modify .env file in the root directory of CAMEL and fill the following lines:



```bash

OPENAI_API_KEY=

```



Replace  with your actual API key.



2. Load the .env file in your Python script: Use the load_dotenv() function from the dotenv module to load the variables from the .env file into the environment. Here's an example:



```python

from dotenv import load_dotenv

import os



# Load environment variables from the .env file

load_dotenv()

```

For more details about the key names in project and how to apply key, 

you can refer to [here](https://github.com/camel-ai/camel/.env).



> [!TIP]

> By default, the load_dotenv() function does not overwrite existing environment variables that are already set in your system. It only populates variables that are missing.

If you need to overwrite existing environment variables with the values from your `.env` file, use the `override=True` parameter:

> ```python

> load_dotenv(override=True)

> ```



After setting the OpenAI API key, you can run the `role_playing.py` script. Find tasks for various assistant-user roles [here](https://drive.google.com/file/d/194PPaSTBR07m-PzjS-Ty6KlPLdFIPQDd/view?usp=share_link).



```bash

# You can change the role pair and initial prompt in role_playing.py

python examples/ai_society/role_playing.py

```



Also feel free to run any scripts below that interest you:



```bash

# You can change the role pair and initial prompt in these python files



# Examples of two agents role-playing

python examples/ai_society/role_playing.py



# The agent answers questions by utilizing code execution tools.

python examples/toolkits/code_execution_toolkit.py



# Generating a knowledge graph with an agent

python examples/knowledge_graph/knowledge_graph_agent_example.py  



# Multiple agents collaborating to decompose and solve tasks

python examples/workforce/multiple_single_agents.py 



# Use agent to generate creative image

python examples/vision/image_crafting.py

```

For additional feature examples, see the [`examples`](https://github.com/camel-ai/camel/tree/master/examples) directory.



## Documentation



The [complete documentation](https://camel-ai.github.io/camel/) pages for the CAMEL package. Also, detailed tutorials for each part are provided below:



### Agents

Explore different types of agents, their roles, and their applications.



- **[Creating Your First Agent](https://docs.camel-ai.org/cookbooks/create_your_first_agent.html)**

- **[Creating Your First Agent Society](https://docs.camel-ai.org/cookbooks/create_your_first_agents_society.html)**

- **[Embodied Agents](https://docs.camel-ai.org/cookbooks/embodied_agents.html)**

- **[Critic Agents](https://docs.camel-ai.org/cookbooks/critic_agents_and_tree_search.html)**



---



### Key Modules

Core components and utilities to build, operate, and enhance CAMEL-AI agents and societies.



| Module | Description |

|:---|:---|

| **[Models](https://docs.camel-ai.org/key_modules/models.html)** | Model architectures and customization options for agent intelligence. |

| **[Messages](https://docs.camel-ai.org/key_modules/messages.html)** | Messaging protocols for agent communication. |

| **[Memory](https://docs.camel-ai.org/key_modules/memory.html)** | Memory storage and retrieval mechanisms. |

| **[Tools](https://docs.camel-ai.org/key_modules/tools.html)** | Tools integration for specialized agent tasks. |

| **[Prompts](https://docs.camel-ai.org/key_modules/prompts.html)** | Prompt engineering and customization. |

| **[Tasks](https://docs.camel-ai.org/key_modules/tasks.html)** | Task creation and management for agent workflows. |

| **[Loaders](https://docs.camel-ai.org/key_modules/loaders.html)** | Data loading tools for agent operation. |

| **[Storages](https://docs.camel-ai.org/key_modules/storages.html)** | Storage solutions for agent. |

| **[Society](https://docs.camel-ai.org/key_modules/society.html)** | Components for building agent societies and inter-agent collaboration. |

| **[Embeddings](https://docs.camel-ai.org/key_modules/embeddings.html)** | Embedding models for RAG. |

| **[Retrievers](https://docs.camel-ai.org/key_modules/retrievers.html)** | Retrieval methods for knowledge access. |

---



### Cookbooks

Practical guides and tutorials for implementing specific functionalities in CAMEL-AI agents and societies.



| Cookbook | Description |

|:---|:---|

| **[Creating Your First Agent](https://docs.camel-ai.org/cookbooks/create_your_first_agent.html)** | A step-by-step guide to building your first agent. |

| **[Creating Your First Agent Society](https://docs.camel-ai.org/cookbooks/create_your_first_agents_society.html)** | Learn to build a collaborative society of agents. |

| **[Society Cookbook](https://docs.camel-ai.org/cookbooks/agents_society.html)** | Advanced configurations for agent societies. |

| **[Model Speed Comparison Cookbook](https://docs.camel-ai.org/cookbooks/model_speed_comparison.html)** | Benchmarking models for performance. |

| **[Message Cookbook](https://docs.camel-ai.org/cookbooks/agents_message.html)** | Best practices for message handling in agents. |

| **[Tools Cookbook](https://docs.camel-ai.org/cookbooks/agents_with_tools.html)** | Integrating tools for enhanced functionality. |

| **[Memory Cookbook](https://docs.camel-ai.org/cookbooks/agents_with_memory.html)** | Implementing memory systems in agents. |

| **[RAG Cookbook](https://docs.camel-ai.org/cookbooks/agents_with_rag.html)** | Recipes for Retrieval-Augmented Generation. |

| **[Prompting Cookbook](https://docs.camel-ai.org/cookbooks/agents_prompting.html)** | Techniques for effective prompt creation. |

| **[Task Generation Cookbook](https://docs.camel-ai.org/cookbooks/task_generation.html)** | Automating task generation for agents. |

| **[Graph RAG Cookbook](https://docs.camel-ai.org/cookbooks/knowledge_graph.html)** | Leveraging knowledge graphs with RAG. |

| **[Role-Playing Scraper for Report & Knowledge Graph Generation](https://docs.camel-ai.org/cookbooks/roleplaying_scraper.html)** | Create role-playing agents for data scraping and reporting. |

| **[Video Analysis](https://docs.camel-ai.org/cookbooks/video_analysis.html)** | Techniques for agents in video data analysis. |

| **[Track CAMEL Agents with AgentOps](https://docs.camel-ai.org/cookbooks/agents_tracking.html)** | Tools for tracking and managing agents in operations. |

| **[Create A Hackathon Judge Committee with Workforce](https://docs.camel-ai.org/cookbooks/workforce_judge_committee.html)** | Building a team of agents for collaborative judging. |

| **[3 Ways to Ingest Data from Websites with Firecrawl](https://docs.camel-ai.org/cookbooks/ingest_data_from_websites_with_Firecrawl.html)** | Explore three methods for extracting and processing data from websites using Firecrawl. |

| **[Data Deneration with CAMEL and Finetuning with Unsloth](https://docs.camel-ai.org/cookbooks/sft_data_generation_and_unsloth_finetuning.html)** | Learn how to generate data with CAMEL and fine-tune models effectively with Unsloth. |

| **[Customer Service Discord Bot with Agentic RAG](https://docs.camel-ai.org/cookbooks/customer_service_Discord_bot_with_agentic_RAG.html)** |  Learn how to build a robust customer service bot for Discord using Agentic RAG. |



## Utilize Various LLMs as Backends



For more details, please see our [`Models Documentation`](https://docs.camel-ai.org/key_modules/models.html#).



## Data (Hosted on Hugging Face)

| Dataset        | Chat format                                                                                         | Instruction format                                                                                               | Chat format (translated)                                                                   |

|----------------|-----------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------|

| **AI Society** | [Chat format](https://huggingface.co/datasets/camel-ai/ai_society/blob/main/ai_society_chat.tar.gz) | [Instruction format](https://huggingface.co/datasets/camel-ai/ai_society/blob/main/ai_society_instructions.json) | [Chat format (translated)](https://huggingface.co/datasets/camel-ai/ai_society_translated) |

| **Code**       | [Chat format](https://huggingface.co/datasets/camel-ai/code/blob/main/code_chat.tar.gz)             | [Instruction format](https://huggingface.co/datasets/camel-ai/code/blob/main/code_instructions.json)             | x                                                                                          |

| **Math**       | [Chat format](https://huggingface.co/datasets/camel-ai/math)                                        | x                                                                                                                | x                                                                                          |

| **Physics**    | [Chat format](https://huggingface.co/datasets/camel-ai/physics)                                     | x                                                                                                                | x                                                                                          |

| **Chemistry**  | [Chat format](https://huggingface.co/datasets/camel-ai/chemistry)                                   | x                                                                                                                | x                                                                                          |

| **Biology**    | [Chat format](https://huggingface.co/datasets/camel-ai/biology)                                     | x                                                                                                                | x                                                                                          |



## Visualizations of Instructions and Tasks



| Dataset          | Instructions                                                                                                         | Tasks                                                                                                         |

|------------------|----------------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------|

| **AI Society**   | [Instructions](https://atlas.nomic.ai/map/3a559a06-87d0-4476-a879-962656242452/db961915-b254-48e8-8e5c-917f827b74c6) | [Tasks](https://atlas.nomic.ai/map/cb96f41b-a6fd-4fe4-ac40-08e101714483/ae06156c-a572-46e9-8345-ebe18586d02b) |

| **Code**         | [Instructions](https://atlas.nomic.ai/map/902d6ccb-0bbb-4294-83a8-1c7d2dae03c8/ace2e146-e49f-41db-a1f4-25a2c4be2457) | [Tasks](https://atlas.nomic.ai/map/efc38617-9180-490a-8630-43a05b35d22d/2576addf-a133-45d5-89a9-6b067b6652dd) |

| **Misalignment** | [Instructions](https://atlas.nomic.ai/map/5c491035-a26e-4a05-9593-82ffb2c3ab40/2bd98896-894e-4807-9ed8-a203ccb14d5e) | [Tasks](https://atlas.nomic.ai/map/abc357dd-9c04-4913-9541-63e259d7ac1f/825139a4-af66-427c-9d0e-f36b5492ab3f) |



## Implemented Research Ideas from Other Works

We implemented amazing research ideas from other works for you to build, compare and customize your agents. If you use any of these modules, please kindly cite the original works:

- `TaskCreationAgent`, `TaskPrioritizationAgent` and `BabyAGI` from *Nakajima et al.*: [Task-Driven Autonomous Agent](https://yoheinakajima.com/task-driven-autonomous-agent-utilizing-gpt-4-pinecone-and-langchain-for-diverse-applications/). [[Example](https://github.com/camel-ai/camel/blob/master/examples/ai_society/babyagi_playing.py)]



- `PersonaHub` from *Tao Ge et al.*: [Scaling Synthetic Data Creation with 1,000,000,000 Personas](https://arxiv.org/pdf/2406.20094). [[Example](https://github.com/camel-ai/camel/blob/master/examples/personas/personas_generation.py)]



## Other Research Works Based on Camel

- [Agent Trust](http://agent-trust.camel-ai.org/): Can Large Language Model Agents Simulate Human Trust Behavior?



- [CRAB](https://crab.camel-ai.org/): Cross-environment Agent Benchmark for Multimodal Language Model Agents.



- OASIS: Open Agents Social Interaction Simulations on a Large Scale.



We warmly invite you to use CAMEL for your impactful research.



## News

πŸ“’ Added the Workforce module to the 🐫 CAMEL framework! For more details, see the [post](https://x.com/CamelAIOrg/status/1851682063830720912). (Oct 31, 2024)

- Added subprocess support for Ollama and vLLM models. (Oct, 29, 2024)

- Integrated Firecrawl's Map into the 🐫 CAMEL framework. (Oct, 22, 2024)

- Integrated Nvidia's Llama-3.1-Nemotron-70b-Instruct! (Oct, 17, 2024)

- ...

- Released AI Society and Code dataset (April 2, 2023)

- Initial release of `CAMEL` python library (March 21, 2023)



## Citation

```

@inproceedings{li2023camel,

  title={CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society},

  author={Li, Guohao and Hammoud, Hasan Abed Al Kader and Itani, Hani and Khizbullin, Dmitrii and Ghanem, Bernard},

  booktitle={Thirty-seventh Conference on Neural Information Processing Systems},

  year={2023}

}

```

## Acknowledgment

Special thanks to [Nomic AI](https://home.nomic.ai/) for giving us extended access to their data set exploration tool (Atlas).



We would also like to thank Haya Hammoud for designing the initial logo of our project.



## License



The source code is licensed under Apache 2.0.



## Contributing to CAMEL 🐫

We appreciate your interest in contributing to our open-source initiative. We provide a document of [contributing guidelines](https://github.com/camel-ai/camel/blob/master/CONTRIBUTING.md) which outlines the steps for contributing to CAMEL. Please refer to this guide to ensure smooth collaboration and successful contributions. πŸ€πŸš€



## Contact

For more information please contact [email protected].



[python-image]: https://img.shields.io/badge/Python-3.10%2C%203.11%2C%203.12-brightgreen.svg

[python-url]: https://www.python.org/

[pytest-image]: https://github.com/camel-ai/camel/actions/workflows/pytest_package.yml/badge.svg

[pytest-url]: https://github.com/camel-ai/camel/actions/workflows/pytest_package.yml

[docs-image]: https://img.shields.io/badge/Documentation-grey.svg?logo=github

[docs-url]: https://camel-ai.github.io/camel/index.html

[star-image]: https://img.shields.io/github/stars/camel-ai/camel?label=stars&logo=github&color=brightgreen

[star-url]: https://github.com/camel-ai/camel/stargazers

[package-license-image]: https://img.shields.io/badge/License-Apache_2.0-blue.svg

[package-license-url]: https://github.com/camel-ai/camel/blob/master/licenses/LICENSE



[colab-url]: https://colab.research.google.com/drive/1AzP33O8rnMW__7ocWJhVBXjKziJXPtim?usp=sharing

[colab-image]: https://colab.research.google.com/assets/colab-badge.svg

[huggingface-url]: https://huggingface.co/camel-ai

[huggingface-image]: https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-CAMEL--AI-ffc107?color=ffc107&logoColor=white

[slack-url]: https://join.slack.com/t/camel-ai/shared_invite/zt-2g7xc41gy-_7rcrNNAArIP6sLQqldkqQ

[slack-image]: https://img.shields.io/badge/Slack-CAMEL--AI-blueviolet?logo=slack

[discord-url]: https://discord.camel-ai.org/

[discord-image]: https://img.shields.io/badge/Discord-CAMEL--AI-7289da?logo=discord&logoColor=white&color=7289da

[wechat-url]: https://ghli.org/camel/wechat.png

[wechat-image]: https://img.shields.io/badge/WeChat-CamelAIOrg-brightgreen?logo=wechat&logoColor=white

[twitter-url]: https://twitter.com/CamelAIOrg

[twitter-image]: https://img.shields.io/twitter/follow/CamelAIOrg?style=social&color=brightgreen&logo=twitter