Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/adi-panda/kuebiko
An AI Twitch TTS Chat Bot using GPT-3 and Google Cloud TTS
https://github.com/adi-panda/kuebiko
Last synced: 3 months ago
JSON representation
An AI Twitch TTS Chat Bot using GPT-3 and Google Cloud TTS
- Host: GitHub
- URL: https://github.com/adi-panda/kuebiko
- Owner: adi-panda
- Created: 2022-12-20T02:26:24.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-07-28T17:13:28.000Z (3 months ago)
- Last Synced: 2024-07-29T19:07:57.852Z (3 months ago)
- Language: Python
- Homepage:
- Size: 9.82 MB
- Stars: 343
- Watchers: 18
- Forks: 88
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-ChatGPT-repositories - Kuebiko - An AI Twitch TTS Chat Bot using GPT-3 and Google Cloud TTS (Chatbots)
README
[![Forks][forks-shield]][forks-url]
[![Stargazers][stars-shield]][stars-url]
[![Issues][issues-shield]][issues-url]
Kuebiko
WARNING: This doc is out of date, while it still applies to the legacy mode, I recommend using the Streamer.bot and Speaker.bot Mode instead. If needed a Tutorial will be added, however until then, there will be dragons.
You will need to create a custom system prompt, it is recommended to read up on prompt engineering and trying out a lot.
A Twitch Chat Bot that reads twitch chat and creates a text to speech response using google could api and openai's GPT-3 text completion model.
Explore the docs »
View Demo
·
Report Bug
·
Request Feature
Table of Contents
## YouTube Videl Tutorial !OUTDATED!
[![Product Name Screen Shot][product-screenshot]](https://www.youtube.com/watch?v=EXICATDyYWI&lc=UgzyiL0K3akxPeX9U8F4AaABAgm)
This is a project to setup your very own VTuber AI similar to "Neuro-Sama".
### Built With
- Python
## Getting Started
This is an example of how you may give instructions on setting up your project locally.
To get a local copy up and running follow these simple example steps.
### Prerequisites
- VLC MUST BE DOWNLOADED ON YOUR COMPUTER
In order to install the prerequisites you will need to do:
- Install [poetry](https://python-poetry.org/docs/#installation)
- ```sh
poetry install
```
### Installation
1. Get a OpenAI API Key at [OpenAPIKey](https://openai.com/api/)
2. Get a Twitch API Token at [TwitchToken](https://twitchtokengenerator.com/)
3. Create a Google Cloud Project with TTS Service enabled and download JSON credentials file. [GoogleCloud](https://cloud.google.com/)
4. Clone the repo
```sh
git clone https://github.com/adi-panda/Kuebiko/
```
5. Add the Google Cloud JSON file into the project folder.
6. Rename `.env.example` to `.env` and enter API Keys:
```sh
TWITCH_CHANNEL="You're Twitch Token"
TWITCH_TOKEN="Your TWITCH Channel Name"
OPENAI_API_KEY="Your OpenAI API Key"
GOOGLE_JSON_PATH="Your Google Cloud JSON Path"
BOT_NAME="Neuro-Sama"
ELEVENLABS_APIKEY="Your ElevenLabs API Key"
ELEVENLABS_VOICEID="Your ElevenLabs Voice Id"
WEBSOCKET_URL="Your WebSocket Url"
```
7. Download VTube Studio and use VBAudio Cable to route audio coming from the program.
8. Add the following script into OBS [CaptionsScript](https://gist.github.com/kkartaltepe/861b02882056b464bfc3e0b329f2f174)
9. Create a new text source for captions, and set it to read from a file, select the `subtitle.txt` file from the project folder.
10. In the script options put the name of you're text source.
11. Set the script in transform options to scale to inner bounds, and adjust the size of the captions.
12. Enjoy! For more details watch the attatched video.
13. IN ORDER TO CHANGE THE VOICE OF YOU'RE VTUBER you will need to change the following parameters in main.py
Here is a list of [supported voices](https://cloud.google.com/text-to-speech/docs/voices)
```python
voice = texttospeech.VoiceSelectionParams(
language_code="en-GB",
name= "en-GB-Wavenet-B",
ssml_gender=texttospeech.SsmlVoiceGender.MALE,
)
```
14. Run
```sh
poetry run python main.py
```
## Usage
Use this space to show useful examples of how a project can be used. Additional screenshots, code examples and demos work well in this space. You may also link to more resources.
_For more examples, please refer to the [Documentation](https://example.com)_
## Roadmap
- [ ] Local LLama Support to remove the need for OpenAI and the associated restrictions
See the [open issues](https://github.com/github_username/repo_name/issues) for a full list of proposed features (and known issues).
## Contributing
Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.
If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".
Don't forget to give the project a star! Thanks again!
1. Fork the Project
2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)
3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)
4. Push to the Branch (`git push origin feature/AmazingFeature`)
5. Open a Pull Request
## License
Distributed under the MIT License.
## Contact
[@adi_panda](https://twitter.com/adi_panda) - hello(aṭ)adipanda.me
[@truecaesarlp](https://twitter.com/TrueCaesarLP) - realcaesarlp(aṭ)gmail.com
Project Link: [You are here](https://github.com/adi-panda/Kuebiko/)
## Acknowledgments
- []()
- []()
- []()
[contributors-shield]: https://img.shields.io/github/contributors/github_username/repo_name.svg?style=for-the-badge
[contributors-url]: https://github.com/adi-panda/Kuebiko/graphs/contributors
[forks-shield]: https://img.shields.io/github/forks/adi-panda/Kuebiko.svg?style=for-the-badge
[forks-url]: https://github.com/adi-panda/Kuebiko/network/members
[stars-shield]: https://img.shields.io/github/stars/adi-panda/Kuebiko.svg?style=for-the-badge
[stars-url]: https://github.com/adi-panda/Kuebiko/stargazers
[issues-shield]: https://img.shields.io/github/issues/adi-panda/Kuebiko.svg?style=for-the-badge
[issues-url]: https://github.com/github_username/repo_name/issues
[license-shield]: https://img.shields.io/github/license/github_username/repo_name.svg?style=for-the-badge
[license-url]: https://github.com/github_username/repo_name/blob/master/LICENSE.txt
[linkedin-shield]: https://img.shields.io/badge/-LinkedIn-black.svg?style=for-the-badge&logo=linkedin&colorB=555
[linkedin-url]: https://www.linkedin.com/in/adipanda/
[product-screenshot]: images/screenshot.webp
[Next.js]: https://img.shields.io/badge/next.js-000000?style=for-the-badge&logo=nextdotjs&logoColor=white
[Next-url]: https://nextjs.org/
[React.js]: https://img.shields.io/badge/React-20232A?style=for-the-badge&logo=react&logoColor=61DAFB
[React-url]: https://reactjs.org/
[Vue.js]: https://img.shields.io/badge/Vue.js-35495E?style=for-the-badge&logo=vuedotjs&logoColor=4FC08D
[Vue-url]: https://vuejs.org/
[Angular.io]: https://img.shields.io/badge/Angular-DD0031?style=for-the-badge&logo=angular&logoColor=white
[Angular-url]: https://angular.io/
[Svelte.dev]: https://img.shields.io/badge/Svelte-4A4A55?style=for-the-badge&logo=svelte&logoColor=FF3E00
[Svelte-url]: https://svelte.dev/
[Laravel.com]: https://img.shields.io/badge/Laravel-FF2D20?style=for-the-badge&logo=laravel&logoColor=white
[Laravel-url]: https://laravel.com
[Bootstrap.com]: https://img.shields.io/badge/Bootstrap-563D7C?style=for-the-badge&logo=bootstrap&logoColor=white
[Bootstrap-url]: https://getbootstrap.com
[JQuery.com]: https://img.shields.io/badge/jQuery-0769AD?style=for-the-badge&logo=jquery&logoColor=white
[JQuery-url]: https://jquery.com
### Instructions
Replace API Keys in code and add google cloud json file and program should work!