https://github.com/hesic73/speechsynthsubs
Convert text to synchronized speech and subtitles using Google's Text-to-Speech API.
https://github.com/hesic73/speechsynthsubs
python python3 srt srt-subtitles subtitles text-to-speech
Last synced: about 1 month ago
JSON representation
Convert text to synchronized speech and subtitles using Google's Text-to-Speech API.
- Host: GitHub
- URL: https://github.com/hesic73/speechsynthsubs
- Owner: hesic73
- License: mit
- Created: 2024-07-25T22:43:25.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-07-27T09:05:51.000Z (9 months ago)
- Last Synced: 2025-03-17T20:44:44.196Z (about 2 months ago)
- Topics: python, python3, srt, srt-subtitles, subtitles, text-to-speech
- Language: Python
- Homepage:
- Size: 17.6 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# SpeechSynthSubs
SpeechSynthSubs is a Python application that converts text into spoken audio and synchronizes it with subtitles. It utilizes Google's Text-to-Speech API for audio synthesis and the [pysubs2](https://github.com/tkarabela/pysubs2) library to create subtitle files in the `.srt` format.
**Note**: Defaults are set to **Chinese**, and the script is primarily tested with Chinese text. Adjust settings if using other languages.
## Prerequisites
Before you can use SpeechSynthSubs, make sure you have:
- Python 3.x installed
- A Google Cloud Platform account with billing enabled, to use the Google Text-to-Speech API.
## Installation
```bash
git clone https://github.com/hesic73/SpeechSynthSubs.git
cd SpeechSynthSubs
pip install -r requirements.txt
```
### Set up the Google Cloud Text-to-Speech API
- Follow Google's guide to set up an API key or service account.
- Ensure the API key is accessible as an environment variable:
```bash
export GOOGLE_TTS_API_KEY='your_api_key_here'
```
### Download SpaCy Package
By default, this tool uses Chinese, but SpaCy supports other languages. To download the package for Chinese:
```
python -m spacy download zh_core_web_sm
```
See [SpaCy Usage](https://spacy.io/usage) for more details.
## Usage
The tool supports input either via a text file or directly as a string:
```bash
python main.py -f path/to/your/file.txt
python main.py -t "Your text string here."
```
This will generate an audio file (`output.mp3`) and a subtitle file (`subtitles.srt`) in a directory under `runs/` labeled with the current timestamp.
For more options and detailed usage information, run:
```bash
python main.py --help
```
## Example
### Input Text
```
Python是一种广泛使用的解释型、高级和通用的编程语言。Python支持多种编程范型，包括结构化、过程式、反射式、面向对象和函数式编程。它拥有动态类型系统和垃圾回收功能，能够自动管理内存使用，并且其本身拥有一个巨大而广泛的标准库。它的语言结构以及面向对象的方法，旨在帮助程序员为小型的和大型的项目编写逻辑清晰的代码。
```
### Generated SSML
```
Python是一种广泛使用的解释型、高级和通用的编程语言。Python支持多种编程范型，包括结构化、过程式、反射式、面向对象和函数式编程。它拥有动态类型系统和垃圾回收功能，能够自动管理内存使用，并且其本身拥有一个巨大而广泛的标准库。它的语言结构以及面向对象的方法，旨在帮助程序员为小型的和大型的项目编写逻辑清晰的代码。
```
### Subtitles (.srt)
```
1
00:00:00,000 --> 00:00:04,500
Python是一种广泛使用的解释型、高级和通用的编程语言
2
00:00:04,500 --> 00:00:07,287
Python支持多种编程范型
3
00:00:07,287 --> 00:00:12,017
包括结构化、过程式、反射式、面向对象和函数式编程
4
00:00:12,017 --> 00:00:15,849
它拥有动态类型系统和垃圾回收功能
5
00:00:15,849 --> 00:00:17,929
能够自动管理内存使用
6
00:00:17,929 --> 00:00:21,485
并且其本身拥有一个巨大而广泛的标准库
7
00:00:21,485 --> 00:00:24,891
它的语言结构以及面向对象的方法
8
00:00:24,891 --> 00:00:29,810
旨在帮助程序员为小型的和大型的项目编写逻辑清晰的代码
```
### Audio Output
https://github.com/user-attachments/assets/ad42b762-f116-49aa-be67-7e8cf1c1f20a
## Appendix
### Supported Chinese Voices
The following table lists the supported Chinese voices available in the Google Cloud Text-to-Speech API:
| Language | Voice type | Language code | Voice name | SSML gender |
| ---------------- | ---------- | ------------- | ----------------- | ----------- |
| Mandarin Chinese | Standard | cmn-CN | cmn-CN-Standard-A | FEMALE |
| Mandarin Chinese | Standard | cmn-CN | cmn-CN-Standard-B | MALE |
| Mandarin Chinese | Standard | cmn-CN | cmn-CN-Standard-C | MALE |
| Mandarin Chinese | Standard | cmn-CN | cmn-CN-Standard-D | FEMALE |
| Mandarin Chinese | Premium | cmn-CN | cmn-CN-Wavenet-A | FEMALE |
| Mandarin Chinese | Premium | cmn-CN | cmn-CN-Wavenet-B | MALE |
| Mandarin Chinese | Premium | cmn-CN | cmn-CN-Wavenet-C | MALE |
| Mandarin Chinese | Premium | cmn-CN | cmn-CN-Wavenet-D | FEMALE |
For more information on the voices available and their capabilities, please refer to the [Google Cloud Text-to-Speech Documentation](https://cloud.google.com/text-to-speech/docs/voices).