https://github.com/messingliu/AIVideoChat
This is an AI video chat tool with anybody (your girlfriend, your idol etc) you want using LLM
https://github.com/messingliu/AIVideoChat
Last synced: 3 months ago
JSON representation
This is an AI video chat tool with anybody (your girlfriend, your idol etc) you want using LLM
- Host: GitHub
- URL: https://github.com/messingliu/AIVideoChat
- Owner: messingliu
- Created: 2023-06-05T08:25:40.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2023-06-05T09:07:32.000Z (over 2 years ago)
- Last Synced: 2025-01-06T00:36:03.392Z (11 months ago)
- Language: JavaScript
- Homepage:
- Size: 895 KB
- Stars: 3
- Watchers: 1
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome_ai_agents - Aivideochat - This is an AI video chat tool with anybody (your girlfriend, your idol etc) you want using LLM (Building / Tools)
README
# AI Chat with Anybody
## This is a video chat tool with anybody you want using Chatgpt
## Your only need a photo of the person (your girlfriend, your idol, your friends never met again)
* The app will connect with the AI video chat
* You can talk and the tool will convert your voice to text
* The tool will use chatgpt to mimic your friend and chat with you
* The tool will get the result from chatgpt and use d-id to create the video streaming with your friend's photo
* Your chat history will be stored in memory.json file and the AI will have the memory and answer question smartly
* The voice used is from microsoft voices, I tried some voice clone model to train voice like the friend. But it needs some training data and finetune which I am still working on it for better performance.
## Initial Setup:
* (install express) open a terminal in the folder and run - npm install express
* Register an did account in https://studio.d-id.com/, there will be some trail credit for free.
* (add your did api key) edit the `api.json` inside the uncompressed folder and replace with your key
* (add your chatgpt api key) edit the `api.json` inside the uncompressed folder with your key
* (add your friend's photo) edit source_portrait_url in `api.json` with the photo url, you can upload the photo to did (https://studio.d-id.com/editor)
* There is some other configs in the `api.json`, feel free to update
*
## Start the app:
* (bring up the app) in the folder (ctr left click on folder through finder) open the terminal run node app.js
* You should see this message - server started on port localhost:5000
* (open the app) in the browser add localhost:5000
* (connect) press Call you should see the connection ready
* (stream) press the Chat button to start chatting
## App:
