https://github.com/vroomai/vst
🎹 Generate sounds from words. Directly in your DAW.
https://github.com/vroomai/vst
audio generative-art machine-learning vst vst3
Last synced: 7 months ago
JSON representation
🎹 Generate sounds from words. Directly in your DAW.
- Host: GitHub
- URL: https://github.com/vroomai/vst
- Owner: vroomai
- License: apache-2.0
- Created: 2023-03-24T23:58:48.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-03-06T17:51:54.000Z (over 1 year ago)
- Last Synced: 2024-10-28T11:51:57.561Z (12 months ago)
- Topics: audio, generative-art, machine-learning, vst, vst3
- Language: C++
- Homepage: https://vroomai.com
- Size: 458 KB
- Stars: 105
- Watchers: 2
- Forks: 3
- Open Issues: 2
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
VroomAI
Generate sounds from words. Directly in your DAW.
Featured in Ableton's blog post, AI and Music-Making.
Checkout our latest project, Vroom Live.
## Summary
In the last few months the field of text-to-audio AI models has [rapidly evolved](https://github.com/archinetai/audio-ai-timeline). VroomAI is a VST plugin delivering the latest text-to-audio AI models directly to artists.
VroomAI was created as a submission to the [2023 Neural Audio Plugin Competition](https://www.theaudioprogrammer.com/neural-audio).
## Usage
Audio samples are saved into a user-specified directory and can be played at various pitches inside the DAW.
## Available Models
- [AudioLDM (Haohe Liu, Zehua Chen, Yi Yuan, Xinhao Mei, Xubo Liu, Danilo Mandic, Wenwu Wang, Mark D. Plumbley).](https://github.com/haoheliu/AudioLDM)
- *[MusicLM](https://google-research.github.io/seanet/musiclm/examples/) (Internal implementation coming soon)*
## Installation
At the moment the quickest way to get things working is to directly build the VST on your machine so we don't need to worry about code signing. A public inference server will be available shortly at vroomai.com but in the meantime you can host your own using [Haohe Liu's app.py](https://github.com/haoheliu/AudioLDM/blob/main/app.py) with the api enabled.
This plugin has only ever been tested on Reaper and Ableton on MacOS (M2).
## Discord
If you want to ask any questions or follow updates - [join the discord](https://discord.gg/Ua8sqvjher)!
## Authors
[Monty Anderson](https://montyanderson.net) ([Prodia Labs](https://prodia.com))
[Barney Hill](https://www.barneyhill.com) (University of Oxford)