https://github.com/aifsh/cosyvoice-comfyui

a comfyui custom node for CosyVoice
https://github.com/aifsh/cosyvoice-comfyui

Last synced: 1 day ago
JSON representation

a comfyui custom node for CosyVoice

• Host: GitHub
• URL: https://github.com/aifsh/cosyvoice-comfyui
• Owner: AIFSH
• License: apache-2.0
• Created: 2024-07-11T02:44:35.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-09-10T22:21:37.000Z (3 months ago)
• Last Synced: 2024-12-14T21:04:56.823Z (9 days ago)
• Language: Python
• Size: 1.12 MB
• Stars: 186
• Watchers: 2
• Forks: 25
• Open Issues: 42
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# CosyVoice-ComfyUI

a comfyui custom node for [CosyVoice](https://github.com/FunAudioLLM/CosyVoice),you can find workflow in [workflows](./workflows/)

## new Feature

suport `srt` file to single voice or mutiple voice clone

input

- [tts_srt](./workflows/dubbing/zh_test.srt)

- [prompt_wav](./workflows/dubbing/test.mp3)

- [prompt_srt](./workflows/dubbing/en_test.srt)(optional)

output

## Example

test on 2080ti 11GB torch==2.3.0+cu121 python 3.10.8

use case | tts_text | prompt_text | prompt_wav | instruct_text | output 

----- | ---- | ---- | ---- | ---- | ----

`base tts` | `你好，我是通义生成式语音大模型，请问有什么可以帮您的吗` | | | | 

`3s clone tts` | `收到好友从远方寄来的生日礼物，那份意外的惊喜与深深的祝福让我心中充满了甜蜜的快乐，笑容如花儿般绽放。` |  `希望你以后能够做的比我还好呦。` |  |  | 

`cross lingual` | "And then later on, fully acquiring that company. So keeping management in line, interest in line with the asset that\\'s coming into the family is a reason why sometimes we don\\'t buy the whole thing." | |  | | 

`instruct` | `在面对挑战时，他展现了非凡的勇气与智慧。` | | | `Theo \\'Crimson\\', is a fiery, passionate rebel leader. Fights with fervor for justice, but struggles with impulsiveness.` |  

## How to use

test on py3.10，2080ti 11gb，torch==2.3.0+cu121

make sure `ffmpeg` is worked in your commandline

for Linux

```

apt update

apt install ffmpeg

```

for Windows,you can install `ffmpeg` by [WingetUI](https://github.com/marticliment/WingetUI) automatically

then!

```

## in ComfyUI/custom_nodes

git clone https://github.com/AIFSH/CosyVoice-ComfyUI.git

cd CosyVoice-ComfyUI

pip install -r requirements.txt

```

weights will be downloaded from modelscope

## Tutorial

- [DEMO](https://www.bilibili.com/video/BV16H4y1w7su)