https://github.com/theonlyamos/cognitrix
Create AI Agents equipped with tools and extensions
https://github.com/theonlyamos/cognitrix
agent ai ai-agent autonomous-agents clarifai-api claude-3 cognitrix cohere-ai gemini-pro gemini-pro-vision gpt-4-api gpt-4-vision groq-ai-api mixtral-8x7b togetherai
Last synced: 2 months ago
JSON representation
Create AI Agents equipped with tools and extensions
- Host: GitHub
- URL: https://github.com/theonlyamos/cognitrix
- Owner: theonlyamos
- License: apache-2.0
- Created: 2024-03-13T10:27:03.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-04-03T17:45:39.000Z (3 months ago)
- Last Synced: 2025-04-20T16:11:40.106Z (2 months ago)
- Topics: agent, ai, ai-agent, autonomous-agents, clarifai-api, claude-3, cognitrix, cohere-ai, gemini-pro, gemini-pro-vision, gpt-4-api, gpt-4-vision, groq-ai-api, mixtral-8x7b, togetherai
- Language: Python
- Homepage:
- Size: 1.9 MB
- Stars: 11
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
# Cognitrix
Cognitrix is an open-source autonomous AI agents orchestrator built in Python. It allows you to create and manage AI agents with ease and integrates seamlessly with large language models (LLMs) from various providers.
## Features
- **Agent Creation and Management:** Create, list, and load AI agents with customizable names, tasks, and configurations.
- **LLM Integration:** Integrates with multiple LLM providers, including Anthropic (Claude), Cohere, Groq, Google, OpenAI, and Together.
- **Modular Architecture:** Easily extensible, allowing the addition of new tools, agents, and LLM integrations.
- **Conversational Interface:** Interact with AI agents through a command-line interface, providing queries and receiving responses.
- **Tool Integration:** Agents can utilize a variety of tools, including calculators, web searches, file system browsers, and more.
- **Autonomous Agent Mode:** Agents can operate autonomously, visually perceiving the screen, interacting with UI elements, and performing tasks.
- **Multimodal Support:** Handles both text and image inputs/outputs, enabling multimodal interactions.
## Architecture
Cognitrix's architecture is designed to be highly modular and extensible:
- **Agents:** The base `Agent` class is for creating and managing AI agents.
- **LLMs:** A collection of classes for integrating with various LLM providers (Cohere, OpenAI, Claude, etc.).
- **Tools:** A set of tools that agents can utilize. Each tool has a `category` attribute for grouping and management.
- **Templates:** Customizable prompt templates guide the behavior and output formats of LLMs.
More tools can be added by creating new classes that inherit from the `Tool` base class and specifying a unique `category`.
## Installation
**Install with pip**:
```bash
pip install cognitrix
```
**Build from source**:
```bash
git clone https://github.com/theonlyamos/cognitrix.git
cd cognitrix/frontend
npm install
npm run dev
cd ..
pip install .
```
**Install directly from github**:
```bash
pip install https://github.com/theonlyamos/cognitrix/archive/main.zip
```
**Build the Docker Image**:
```bash
git clone https://github.com/theonlyamos/cognitrix.git
cd cognitrix
docker build -t cognitrix .
```
## Usage
**Fill these environment variables as needed**
```bash
OPENAI_API_KEY=
CO_API_KEY=
TAVILY_API_KEY=
CLARIFAI_ACCESS_TOKEN=
GROQ_API_KEY=
GOOGLE_API_KEY=
NEWSAPI_API_KEY=
ANTHROPIC_API_KEY=
DEEPGRAM_API_KEY=
MINDSDB_API_KEY=
BRAVE_SEARCH_API_KEY=
AIMLAPI_API_KEY=
```
To run Cognitrix with default settings:
```bash
cognitrix
```
**Access the Web UI**
To run with web interface
```bash
cognitrix --ui web
```
Open your web browser and go to `http://localhost:8000` to access the web UI.
**Run the Docker Container**
After building the image, you can run the container with:
```bash
docker run -p 8000:8000 cognitrix
```
This command maps port 8000 of the container to port 8000 on your host machine.
To list supported LLM providers:
```bash
cognitrix --providers
```
To list created agents:
```bash
cognitrix agents
```
To list available tools:
```bash
cognitrix --tools
```
To run Cognitrix with a specific provider:
```bash
cognitrix --provider
```
To run Cognitrix with a specific agent:
```bash
cognitrix --agent
```
To run Cognitrix with a category of tools:
```bash
cognitrix --load-tools "web"
```
To run Cognitrix with categories of tools:
```bash
cognitrix --load-tools "web,general"
```
To create a new agent:
```bash
cognitrix agents --new
```
For more options and usage details, use the help command:
```bash
cognitrix --help
```
## Web UI
Cognitrix includes a web UI built with Svelte and TypeScript. This UI allows users to interact with the AI agents and manage their configurations easily.
### Development
For development purposes, you can also run the web UI locally without Docker. Ensure you have Node.js and npm installed, then follow these steps:
1. **Install Dependencies**:
Navigate to the `frontend` directory and run:
```bash
npm install
```
2. **Start the Development Server**:
Run the following command to start the development server:
```bash
npm run dev
```
3. **Access the Development Server**:
Open your web browser and go to `http://localhost:5173` to view the web UI in development mode.
## Contributing
Cognitrix is open source and contributions are welcome! Please refer to [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines on how to contribute.
## License
This project is licensed under the MIT license. See [LICENSE.md](LICENSE.md) for more information.
## Acknowledgments
Cognitrix was created by [Amos Amissah](https://github.com/theonlyamos) and is inspired by projects like AutoGPT and GPTEngineer. Special thanks to the open-source community and AI companies providing LLM APIs.