https://github.com/mourad-ghafiri/OpenMindedChatbot

OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabilities to provide comprehensive and flexible responses to user queries.
https://github.com/mourad-ghafiri/OpenMindedChatbot

Last synced: 25 days ago
JSON representation

OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabilities to provide comprehensive and flexible responses to user queries.

• Host: GitHub
• URL: https://github.com/mourad-ghafiri/OpenMindedChatbot
• Owner: mourad-ghafiri
• Created: 2023-12-19T12:06:57.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2023-12-19T12:13:01.000Z (11 months ago)
• Last Synced: 2024-07-22T05:23:48.889Z (4 months ago)
• Language: Python
• Homepage:
• Size: 6.14 MB
• Stars: 26
• Watchers: 1
• Forks: 3
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# OpenMindedChatbot

## Overview

OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabilities to provide comprehensive and flexible responses to user queries. It operates in two modes: a standard mode for general queries and an 'Open Minded' mode that allows for more unrestricted and creative responses.

## Features

- **Dual Mode Operation**: Choose between 'Normal' and 'Open Minded' modes to tailor the chatbot's responses to your needs.

- **Function as a Service**: OpenMindedChatbot incorporates several service functions, including:

  1. **Internet Browsing Service**: Utilizes DuckDuckGo for efficient web scraping.

  2. **Weather Service**: Provides current weather updates.

  3. **Time Service**: Offers accurate time information.

  4. **Math Engine**: Solves complex mathematical problems.

  5. **Terminal Service**: Access your terminal directly through the chatbot. (Note: Use this service with caution as it will utilize your local terminal.)

## Architecture

![Alt text](Architecture.png)

## Application Screenshots

![Alt text](screen1.png)

![Alt text](screen2.png)

![Alt text](screen3.png)

![Alt text](screen4.png)

![Alt text](screen5.png)

![Alt text](screen6.png)

## Models

OpenMindedChatbot uses the following models for its operations:

- **LLM**: TheBloke/Marcoroni-7B-v3-GGUF/marcoroni-7b-v3.Q8_0.gguf

- **Function Calling**: TheBloke/NexusRaven-V2-13B-GGUF/nexusraven-v2-13b.Q5_0.gguf

Users can change these models in the `src/configs/config` file. The GGUF files for these models can be downloaded via LM Studio or Hugging Face.

## Dependencies

- llama-cpp-python

- fastapi

- uvicorn

- websockets

- python-multipart

- requests

- bs4

## Installation

1. Install dependencies:

    ```bash

    pip install -r requirements.txt

    ```

2. Run the application:

    ```bash

    uvicorn main:app

    ```

3. Navigate to `http://127.0.0.1:8000` in your web browser.

## Enjoy OpenMindedChatbot

Experience the flexibility and power of OpenMindedChatbot in answering a wide range of questions and performing various tasks. Enjoy exploring its capabilities!