https://github.com/purposeachiever6/chatbot-with-text-voice-chatting

Telegram bot is developed by AI techniques(Speech-to-Text, Text-to-Speech, Voice-cloning, AI-avatar-geneartor) and telegram bot developing techniques.
https://github.com/purposeachiever6/chatbot-with-text-voice-chatting

Last synced: about 1 month ago
JSON representation

Telegram bot is developed by AI techniques(Speech-to-Text, Text-to-Speech, Voice-cloning, AI-avatar-geneartor) and telegram bot developing techniques.

• Host: GitHub
• URL: https://github.com/purposeachiever6/chatbot-with-text-voice-chatting
• Owner: PurposeAchiever6
• Created: 2023-11-18T04:45:34.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2023-11-18T04:52:44.000Z (about 1 year ago)
• Last Synced: 2024-08-22T20:19:06.180Z (4 months ago)
• Language: Python
• Size: 60.4 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: Readme.md

Awesome Lists containing this project

README

        
# Telegram Bot "My Friend"

Telegram Bot "My Friend" is bot to help customers to make theirself friends. This bot is developed by AI techniques(Speech-to-Text, Text-to-Speech, Voice-cloning, AI-avatar-geneartor) and telegram bot developing techniques. This bot can chat with customer through text and voice.

This bot responses as text when customers ask as text, and if customers ask as voice, it responses as video.

Customers can set their pictures and voice. This bot can make video with customer pictures and voices.

## Setup

### Setup 1: Building Environment

- Download code from gitlab

  `git clone https://gitlab.com/lambda-vision/customersupportgpt.git`

- Reseetting API keys

    - On the bot_src/private_env.py

      

      DG_KEY = 'c6a441dc5efbbd7e1ef959348c122aec01c325b62'

      OPENAI_KEY = "sk-Ke7ePCgDFKF3l18m6HmTRs9lbkFJRXDobcl72SOaldgD18FT"

      SERP_API_KEY = "3e4d6384rf3ecf52dd4a2868843784f73ed36fb823496b856158503414febe689"

    - Creating ".env" file and Input serpapi_key

    `SERPAPI_API_KEY = 3e4d6384rf3ecf52dd4a2868843784f73ed36fb823496b856158503414febe689`

- Make folder "voice_message"

- Downloading models (Run ./scripts/download_models.sh)

    

    `bash ./scripts/download_models.sh`

### Setup 2: Install Libraries

- Install all libraries on requirements.txt

  `!pip install -r requirements.txt`

## Useage

### Run Telegram Bot

`python telegram-bot.py`

### Setting Customer Pictures and voice

Users can set their pictures and voice. When Users upload their pictures and record their voice, the bot saves their pictures and clones users voice, and make video with their pictures and voice

Users start with bot using '/start'. If u do, the bot send first message with customer setting buttons. In this here, you can set your pictures and clone your voice.

- 🔥 The telegram bot: voice-to-video response.

 

#### Pictures

- Click "Set Picture"

- Users upload pictures. The picture's size must be at least 500*500. And the picture's type is '.png'

- If uploaded successfully, bot sends message "Congratulations!, Successfully uploaded your picture". When failed to upload pictures, bot sends message "Failed to upload your pictures. Please try again".

#### Voice Cloning

- Click "Clone Voice"

- Users send voice message, the legnth is 30~40s. If users send voice message, the bot clones user's voice with this voice message.

- If successfully clone voice, the bot sends message "Congratulations!, Successfully cloned your voice". If failed to clone voice, the bot sends "I am sorry. Failed to clone your voice"

- 🔥 customer settings

 

- 🔥 Genearte video with customer picture and voice

| voice_source                  | Video based on customer picture and cloned voice       |   customer pictures |

|:--------------------: |:--------------------: | :----: |

|   |    |