Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/rongjc/autosubtitle
This is a repository to use open AI's whisper API and chatGPT for auto subtitle generation
https://github.com/rongjc/autosubtitle
Last synced: 2 months ago
JSON representation
This is a repository to use open AI's whisper API and chatGPT for auto subtitle generation
- Host: GitHub
- URL: https://github.com/rongjc/autosubtitle
- Owner: rongjc
- License: mit
- Created: 2023-03-21T06:36:39.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-03-22T07:14:07.000Z (almost 2 years ago)
- Last Synced: 2024-08-04T03:03:18.883Z (6 months ago)
- Language: Python
- Size: 74.1 MB
- Stars: 16
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- awesome-chatgpt - Autosubtitle - Use GPT to auto generate and translate subtitles (Channel Resources / GitHub Projects)
README
# Auto Subtitle - A tool to auto generate and translate subtitles from vidoes using Open AI's whisper and chatGPT
This is a repository to use open AI's whisper API and chatGPT for auto subtitle generation
## Requirement
1. install ffmpeg
```bash
# on Ubuntu or Debian
sudo apt update && sudo apt install ffmpeg
# on Arch Linux
sudo pacman -S ffmpeg
# on MacOS using Homebrew (https://brew.sh/)
brew install ffmpeg
# on Windows using Chocolatey (https://chocolatey.org/)
choco install ffmpeg
# on Windows using Scoop (https://scoop.sh/)
scoop install ffmpeg
```
2. install requirement
`pip3 install -r requirement.txt`
3. install whisper
`pip install git+https://github.com/openai/whisper.git`
## Performance
- Please be noted that it's a computationally heavy task so it will be quite slow if your hardware specs is low.
- The transcription performance is also not good on mac, most likely due to the ARM architecture is not very well supported by Whisper
- It works quite well on my desktop setup, CPU: xeon e5 2697 v3, RAM: 32GB, GPU: RTX3070 OS: ubuntu
## How to generate subtitle for a video
For example, if you want to generate the subtitle for mx.mp4. you can use the script below
- -i input video file path
- -l input file langulage
- -o output SRT file path
`python3 transcript.py -i ./mx.mp4 -l Japanese -o mx.srt`
## How to translate subtitle for a video
For example, if you want to translate mx2.srt from Japanese to Chinese, you can use the followinig command. This will output the translated result to mx_cn.srt
- -i input SRT file path
- -il input file langulage
- -o output SRT file path
- -ol output SRT language
- -t chatGPT API token
`python3 translate.py -i ./mx2.srt -il Japanese -o ./mx_cn.srt -ol Chinese -t `
## How to merge the SRT file to the video
You can use the attached shell script to combine SRT and the video. Just use
```
./merge-srt-to-mp4.sh vidoe.mp4 subtitle.SRT
```