Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/flo-bit/youtube-speaker-separation
simple python script that outputs separate audio files for each speaker in a youtube video, using whisper on replicate
https://github.com/flo-bit/youtube-speaker-separation
speaker-diarization speech-to-text text-to-speech voice-cloning whisper youtube
Last synced: about 1 month ago
JSON representation
simple python script that outputs separate audio files for each speaker in a youtube video, using whisper on replicate
- Host: GitHub
- URL: https://github.com/flo-bit/youtube-speaker-separation
- Owner: flo-bit
- License: mit
- Created: 2024-06-17T21:56:30.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-06-17T21:58:09.000Z (7 months ago)
- Last Synced: 2024-12-16T11:36:30.447Z (about 1 month ago)
- Topics: speaker-diarization, speech-to-text, text-to-speech, voice-cloning, whisper, youtube
- Language: Python
- Homepage:
- Size: 2.93 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: Readme.md
- License: LICENSE
Awesome Lists containing this project
README
# youtube speaker separation
this script uses whisper on [replicate](https://replicate.com/) to download the audio and then separate the speakers from a youtube video.
- input: youtube url
- output: audio files for each speaker, with all spoken parts of that speaker cut together.
this output can then be used to create ai voices for each speaker, for example with instant voice cloning by [elevenlabs](https://elevenlabs.io/) (note: elevenlabs only official allows this for voices that you own the rights to, i don't take any responsibility for any illegal use of this software.)
## how to use
create a virtual environment and install the requirements:
```bash
python3 -m venv .myenv
source .myenv/bin/activate
pip3 install -r requirements.txt
```
copy and rename `.env.sample` to `.env` and fill the `REPLICATE_API_TOKEN` field with your replicate api token.
run the script with a youtube url as argument:
```bash
python3 script.py "youtube_url"
```
## license
mit