{"id":24206480,"url":"https://github.com/olaviinha/neuraltexttoaudio","last_synced_at":"2025-09-22T05:32:26.716Z","repository":{"id":65715407,"uuid":"580957448","full_name":"olaviinha/NeuralTextToAudio","owner":"olaviinha","description":"Text prompt steered synthetic audio generators","archived":false,"fork":false,"pushed_at":"2023-12-02T15:19:34.000Z","size":345,"stargazers_count":34,"open_issues_count":2,"forks_count":4,"subscribers_count":2,"default_branch":"main","last_synced_at":"2023-12-02T16:27:29.435Z","etag":null,"topics":["audio","audio-generation","audio-processing","audio-synthesis","audioldm","colab","colab-notebook","mubert","mubertai","music-generation","text2audio","text2music","voice-cloning","voice-synthesis"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/olaviinha.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2022-12-21T22:19:49.000Z","updated_at":"2023-11-14T22:11:22.000Z","dependencies_parsed_at":"2023-12-02T16:27:27.963Z","dependency_job_id":"5cbbf99b-c7cb-4b7e-a67b-a977449bbf46","html_url":"https://github.com/olaviinha/NeuralTextToAudio","commit_stats":null,"previous_names":[],"tags_count":0,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olaviinha%2FNeuralTextToAudio","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olaviinha%2FNeuralTextToAudio/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olaviinha%2FNeuralTextToAudio/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/olaviinha%2FNeuralTextToAudio/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/olaviinha","download_url":"https://codeload.github.com/olaviinha/NeuralTextToAudio/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":233828203,"owners_count":18736577,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["audio","audio-generation","audio-processing","audio-synthesis","audioldm","colab","colab-notebook","mubert","mubertai","music-generation","text2audio","text2music","voice-cloning","voice-synthesis"],"created_at":"2025-01-14T00:33:29.097Z","updated_at":"2025-09-22T05:32:26.690Z","avatar_url":"https://github.com/olaviinha.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Colab notebooks for text-to-audio generators\n\n❗️ **This repository is not actively maintained since 2023, as closed-source state-of-the-art text-to-audio solutions are now widely available for everyone.**\n\nUser-friendly Colab notebooks for various text prompt steered synthetic audio generators.\n\n**Available notebooks:**\n\n- [AudioLDM](https://colab.research.google.com/github/olaviinha/NeuralTextToAudio/blob/main/AudioLDM_pub.ipynb) – _text-to-audio_\n- [TorToiSe TTS](https://colab.research.google.com/github/olaviinha/NeuralTextToAudio/blob/main/tortoise_tts_pub.ipynb) – _text-to-speech w/ voice-cloning_\n- [MubertAI Text-to-Music](https://colab.research.google.com/github/olaviinha/NeuralTextToMusic/blob/main/mubert_txt2music.ipynb) – _text-to-music_\n- [TTS Voice Cloning](https://colab.research.google.com/github/olaviinha/NeuralTextToAudio/blob/main/TTS_voice_cloning_pub.ipynb) – _text-to-speech w/ voice-cloning_\n\n---\n\n## AudioLDM: Text-to-Audio Generation with Latent Diffusion Models\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/olaviinha/NeuralTextToAudio/blob/main/AudioLDM_pub.ipynb)\n\nPaper: [Text-to-Audio Generation with Latent Diffusion Models](https://arxiv.org/abs/2301.12503)\n\nColab for [AudioLDM](https://github.com/haoheliu/AudioLDM). Generates audio based on text description. This is probably the beginning of _\"Stable Diffusion of audio\"_. Currently capable of producing 16 kHz audio only.\n\n---\n\n## TorToiSe: Text-to-speech\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/olaviinha/NeuralTextToAudio/blob/main/tortoise_tts_pub.ipynb)\n\nPaper: [TorToiSe - Spending Compute for High Quality TTS](https://docs.google.com/document/d/13O_eyY65i6AkNrN_LdPhpUjGhyTNKYHvDrIvHnHe1GA)\n\nColab for [TorToiSe](https://github.com/neonbjb/tortoise-tts) text-to-speech voice-cloning. This notebook takes a text string and an audio file (or files) of a speaker's voice, and attempts to synthesize the text using the given voice. Currently works with English text only.\n\n---\n\n## MubertAI Text-to-Music\n\nUPDATE: it seems like Mubert API now requires (paid) API key.\n\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/olaviinha/NeuralTextToMusic/blob/main/mubert_txt2music.ipynb)\n\nColab for [MubertAI Text-to-Music](https://github.com/MubertAI/Mubert-Text-to-Music). Generates music using predefined blocks created by the community (afaik) based on text description. See the [source repository](https://github.com/MubertAI/Mubert-Text-to-Music) for information, such as licensing.\n\n---\n\n## TTS Voice Cloning\n\n[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/olaviinha/NeuralTextToAudio/blob/main/TTS_voice_cloning_pub.ipynb)\n\nPaper: [Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis](https://arxiv.org/pdf/1806.04558.pdf)\n\nColab for [Real-Time-Voice-Cloning](https://github.com/CorentinJ/Real-Time-Voice-Cloning) text-to-speech voice-cloning. This notebook takes a text string and an audio file of a speaker's voice, and attempt to synthesize the text using the given voice. Fair warning: results are not great.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Folaviinha%2Fneuraltexttoaudio","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Folaviinha%2Fneuraltexttoaudio","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Folaviinha%2Fneuraltexttoaudio/lists"}