https://github.com/shadowcz007/Comfyui-ChatTTS

https://github.com/shadowcz007/Comfyui-ChatTTS

chattts comfyui openvoice podcast voiceclone

Last synced: 3 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/shadowcz007/Comfyui-ChatTTS
• Owner: shadowcz007
• License: mit
• Created: 2024-06-05T12:38:21.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-07-26T10:57:35.000Z (9 months ago)
• Last Synced: 2024-07-26T12:27:38.629Z (9 months ago)
• Topics: chattts, comfyui, openvoice, podcast, voiceclone
• Language: Python
• Homepage:
• Size: 904 KB
• Stars: 39
• Watchers: 2
• Forks: 0
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-hacking-lists - shadowcz007/Comfyui-ChatTTS - (Python)

README

        
# Comfyui-ChatTTS

> [寻求帮助 Mixlab nodes discord](https://discord.gg/cXs9vZSqeK)

> [推荐：mixlab-nodes](https://github.com/shadowcz007/comfyui-mixlab-nodes)

目前可以创建音色，复用音色，支持多人对话模式的生成，寻求帮助可以加入[discord](https://discord.gg/cXs9vZSqeK),注意输入的text不需要加[speed_3][laugh_2]这种手动控制的标签。

> 案例 : 多人对话 x 脱口秀

[![alt text](assets/1718816711480.png)](https://www.youtube.com/embed/s6O9aKrr3pM?si=--mwIX1rR0axEQFn)

![alt text](assets/1718851026553.png)

节点：

ChatTTS

Multi Person Podcast

CreateSpeakers

SaveSpeaker 、LoadSpeaker : 方便保存和加载音色,支持 [ChatTTS_Speaker/summary](https://modelscope.cn/studios/ttwwwaa/ChatTTS_Speaker/summary) 的音色加载

Load Whisper Model、Whisper Transcribe:方便导出音频对应的字幕文件

OpenVoiceClone ：方便迁移音色，更好地控制角色声音

![alt text](assets/03dd6465a900e81a6e1812302efc2b4.png)

模型：

下载后放到 ```models/chat_tts```

https://huggingface.co/2Noise/ChatTTS

音色pt文件放到```models/chat_tts_speaker```

[openvoice 模型](https://myshell-public-repo-hosting.s3.amazonaws.com/openvoice/checkpoints_v2_0417.zip)放到```models/open_voice```

[whisper模型](https://github.com/SYSTRAN/faster-whisper/tree/master)放到```models/whisper/large-v3```

![alt text](assets/1719392506548.jpg)

> 分支是一个课程的示例代码:以ChatTTS为例，为ComfyUI增加语音合成功能。一个自定义的节点需要完成：

python 运行时（后端）- 后端python怎么写

GUI - 怎么修改节点界面

### 相关插件推荐

[comfyui-liveportrait](https://github.com/shadowcz007/comfyui-liveportrait)

[Comfyui-ChatTTS](https://github.com/shadowcz007/Comfyui-ChatTTS)

[comfyui-sound-lab](https://github.com/shadowcz007/comfyui-sound-lab)

[comfyui-Image-reward](https://github.com/shadowcz007/comfyui-Image-reward)

[comfyui-ultralytics-yolo](https://github.com/shadowcz007/comfyui-ultralytics-yolo)

[comfyui-moondream](https://github.com/shadowcz007/comfyui-moondream)