https://github.com/zixiiu/Digital_Life_Server

Yet another voice assistant, but alive.
https://github.com/zixiiu/Digital_Life_Server

Last synced: 2 days ago
JSON representation

Yet another voice assistant, but alive.

• Host: GitHub
• URL: https://github.com/zixiiu/Digital_Life_Server
• Owner: zixiiu
• License: mit
• Created: 2023-04-27T14:40:02.000Z (almost 2 years ago)
• Default Branch: master
• Last Pushed: 2023-12-01T15:06:19.000Z (about 1 year ago)
• Last Synced: 2025-02-15T01:03:47.427Z (6 days ago)
• Language: Python
• Homepage:
• Size: 39.1 KB
• Stars: 2,508
• Watchers: 22
• Forks: 472
• Open Issues: 61
• Metadata Files:
  • Readme: readme.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Digital Life Server

这是「数字生命」服务部分代码。包括与前端通信，语音识别，chatGPT接入和语音合成。  

For other part of the project, please refer to:  

[Launcher](https://github.com/CzJam/DL_Launcher) 启动此服务器的图形界面。  

[UE Client](https://github.com/QSWWLTN/DigitalLife) 用于渲染人物动画，录音，和播放声音的前端部分。    

详细的配置流程可参见[readme_detail.md](readme_detail.md)

## Getting stuffs ready to roll:

### Clone this repo

```bash

git clone https://github.com/zixiiu/Digital_Life_Server.git --recursive

```

### Install prerequisites

1. install pytorch

    ```bash

    pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118

    ```

2. install other requirements

    ```bash

    pip install -r requirements.txt

    ```

3. Build `monotonic_align`  

   This may not work that well but you know what that suppose to mean.

   ```bash

   cd "TTS/vits/monotonic_align"

   mkdir monotonic_align

   python setup.py build_ext --inplace

   cp monotonic_align/*.pyd .

   ```

4. Download models  

   [百度网盘](https://pan.baidu.com/s/1EnHDPADNdhDl71x_DHeElg?pwd=75gr)  

   ASR Model:   

   to `/ASR/resources/models`  

   Sentiment Model:  

   to `/SentimentEngine/models`  

   TTS Model:  

   to `/TTS/models`

5. （对于**没有**Nvidia显卡的电脑，采用cpu来跑的话）需要额外做一步：

   ​	将 Digital_Life_Server\TTS\TTService.py 文件下 36行

   ```

   self.net_g = SynthesizerTrn(...).cuda()

   修改为

   self.net_g = SynthesizerTrn(...).cpu()

   ```

   

   > 到这里，项目构建完毕🥰

### Start the server

   ```bash

   run-gpt3.5-api.bat

   ```