Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/adiksondev/youtranslate
Takes a youtube video, clones the voice and re-creates that video in a different language
https://github.com/adiksondev/youtranslate
ai collaborate elevenlabs-api github localization-tool translation voice-cloning voice-recognition youtube
Last synced: 1 day ago
JSON representation
Takes a youtube video, clones the voice and re-creates that video in a different language
- Host: GitHub
- URL: https://github.com/adiksondev/youtranslate
- Owner: AdiKsOnDev
- License: mit
- Created: 2023-07-28T21:17:22.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-02-26T05:16:10.000Z (11 months ago)
- Last Synced: 2024-06-19T03:10:50.859Z (7 months ago)
- Topics: ai, collaborate, elevenlabs-api, github, localization-tool, translation, voice-cloning, voice-recognition, youtube
- Language: Python
- Homepage:
- Size: 30.6 MB
- Stars: 70
- Watchers: 1
- Forks: 12
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- Contributing: docs/CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
[](https://codespaces.new/AdiKsOnDev/YouTranslate)
YouTranslate is a Python script that allows you to create multilingual YouTube videos by cloning the voice of the video's author and translating the video's transcript to a different language. The script then performs a voice-over using the translated script and cloned voice, enabling you to reach a broader audience by offering content in multiple languages!
## :open_file_folder: Installation
1. Go to the most recent production-ready release and install the zip with the source code
2. Ensure you have Python 3.11+ installed on your system.
3. Install the required dependencies by running the following command:
```bash
pip install -r requirements.txt
```
## :exclamation: Prerequisites
To use YouTranslate, you will need the following:
- An API Key for the ElevenLab's speech synthesis (See [ElevenLabs API](https://docs.elevenlabs.io/api-reference/quick-start/introduction))
- A YouTube video URL for which you want to create a multilingual version.
## :scroll: Usage
1. Run the Script:
- Create a `.env` file and write `API_KEY = "Your elevenlabs api key"` in it
- Open your terminal or command prompt.
- Execute the following command:
```bash
python main.py
```
2. Review the Output:
- The script will process the video, clone the voice, translate the transcript, and generate the final multilingual version.
- After completion, you will find the multilingual video file in the `videos/` directory (`Final_Video.mp4`).
- Add background sounds, polish the video. (If you are the author of the original video and you still have the video's assets on your computer)
- Don't forget that the voice synthesis is not able to copy original author's pacing. You will have to edit the video to make it as good as possible
3. Upload to YouTube:
- Upload the generated `Final_Video.mp4` to your YouTube channel and publish it to reach a wider audience.
## :question: How It Works
YouTranslate utilizes ElevenLabs' voice cloning API and 'googletrans' python library to create multilingual YouTube videos. The steps involved are as follows:
1. Getting the video and Cloning the voice:
- The script uses voice cloning technology to clone the voice of the video's author, based on the `sample.mp3` file (Original audio track from the video)
2. Transcript Translation:
- The script leverages googletrans library to translate the script to the languages that ElevenLabs' API supports
3. Voice-Over and Video Generation:
- The translated transcript is combined with the voice-over to create the final multilingual video, `Final_Video.mp4`.
## :medical_symbol: Contributing
Contributions to YouTranslate are welcome! If you find any issues or want to improve the script, feel free to submit a pull request. For major changes or new features, please open an issue first to discuss the proposed changes.
For more info, check out [**CONTRIBUTING.md**](./docs/CONTRIBUTING.md)