Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/KevinWang676/ChatGLM2-Voice-Cloning
Chat with any character you like: ChatGLM2+SadTalker+Voice Cloning | 和喜欢的角色沉浸式对话吧:ChatGLM2+声音克隆+视频对话
https://github.com/KevinWang676/ChatGLM2-Voice-Cloning
Last synced: 3 months ago
JSON representation
Chat with any character you like: ChatGLM2+SadTalker+Voice Cloning | 和喜欢的角色沉浸式对话吧:ChatGLM2+声音克隆+视频对话
- Host: GitHub
- URL: https://github.com/KevinWang676/ChatGLM2-Voice-Cloning
- Owner: KevinWang676
- License: mit
- Created: 2023-07-17T02:12:49.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2023-08-11T03:33:22.000Z (about 1 year ago)
- Last Synced: 2024-06-14T02:06:32.771Z (5 months ago)
- Language: Python
- Homepage:
- Size: 717 KB
- Stars: 568
- Watchers: 11
- Forks: 86
- Open Issues: 11
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - KevinWang676/ChatGLM2-Voice-Cloning
README
# ChatGLM2+Voice Cloning+SadTalker 🎶
## Chat with any character you like immersively through ChatGLM2-6B, FreeVC and SadTalker in real time 📺💕🍻
### [简体中文](https://github.com/KevinWang676/ChatGLM2-Voice-Cloning/blob/main/README_zh.md)
## Easy to use 💡(1) Run
```
git clone https://github.com/KevinWang676/ChatGLM2-Voice-Cloning.git
cd ChatGLM2-Voice-Cloning
pip install -r requirements.txt
```(2) Run
```
sudo apt update && sudo apt upgrade
apt install ffmpeg
```(3) Upload `freevc-24.pth` to the folder `./ChatGLM2-Voice-Cloning/checkpoint/`. You can download `freevc-24.pth` through this [link](https://huggingface.co/spaces/kevinwang676/FreeVC/tree/main/checkpoints).
(4) Upload `pretrained_bak_5805000.pt` to the folder `./ChatGLM2-Voice-Cloning/speaker_encoder/ckpt/`. You can download `pretrained_bak_5805000.pt` through this [link](https://huggingface.co/spaces/kevinwang676/FreeVC/tree/main/speaker_encoder/ckpt).
(5) Run `python app_en.py`.
(6) Done! Now you can open Gradio interface and chat with any character you like through ChatGLM2-6B and voice cloning. 💕
P.S. The code is based on [ChatGLM2-6B](https://github.com/THUDM/ChatGLM2-6B), [FreeVC](https://github.com/OlaWod/FreeVC), and [SadTalker](https://github.com/OpenTalker/SadTalker).
### Quick start: [HuggingFace Demo](https://huggingface.co/spaces/kevinwang676/ChatGLM2-VC-SadTalker) 🤗
### If you like the my application, please star this repository. ⭐⭐⭐
Gradio Interface:
![image](https://github.com/KevinWang676/ChatGLM2-Voice-Cloning/assets/126712357/e6eeae6b-3e75-407e-acab-cac2fb93d6a4)