https://github.com/pmlg/generative_music_playground
Links for music + machine learning
https://github.com/pmlg/generative_music_playground
ai generative music
Last synced: about 1 year ago
JSON representation
Links for music + machine learning
- Host: GitHub
- URL: https://github.com/pmlg/generative_music_playground
- Owner: pmlg
- Created: 2019-08-26T09:20:03.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2024-12-09T17:25:01.000Z (over 1 year ago)
- Last Synced: 2024-12-09T18:30:52.262Z (over 1 year ago)
- Topics: ai, generative, music
- Homepage:
- Size: 119 KB
- Stars: 172
- Watchers: 12
- Forks: 18
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Generative Music Playground by Perth Machine Learning Group
## Description
Links for music + machine learning.
This is a curated list of links for people who want to explore generating music with deep learning.
Check https://www.meetup.com/Perth-Machine-Learning-Group/events for updates on in-person meetups
Recommended| | | | | | |
---------------|---|---|---|---|---|---|
**Name** |**Description**|**Demo**|**Code**|**Paper**|**Suitable for**|**Released**|
[Foundation Models for Music: A Survey]([https://arxiv.org/abs/2408.14340])|Review paper on the state-of-the-art foundation models for music|||[Paper](https://arxiv.org/pdf/2408.14340)||August 2024|
**Generating Audio(.wav or .mp3 files)**
[**MusicFX (Google)**](https://aitestkitchen.withgoogle.com/tools/music-fx)|Generate music from text|[Blog](https://google-research.github.io/seanet/musiclm/musicfx/)
[Audio](https://google-research.github.io/seanet/musiclm/examples/)
[Youtube](https://www.youtube.com/watch?v=g6FRkAbZPQo)||[Paper](https://arxiv.org/abs/2301.11325)|Non-coders|December 2023|
[**Stable Audio (Stability AI)**](https://stability.ai/stableaudio)|Generate music and sound effects from text.|||[Research Blog](https://stability.ai/research/stable-audio-efficient-timing-latent-diffusion)
[Github](https://github.com/Stability-AI/stable-audio-tools)
|Non-coders|September 2023|
[**MusicGen (Meta AI)**](https://github.com/facebookresearch/audiocraft)|Generate music from text (controllable)|[Hugging Face Spaces](https://huggingface.co/spaces/facebook/MusicGen)
[Audio](https://huggingface.co/papers/2306.05284)|[Google Colab](https://colab.research.google.com/drive/1-Xe9NCdIs2sCUbiSmwHXozK6AAhMm7_i?usp=sharing)|[Paper](https://arxiv.org/abs/2306.05284)|Non-coders|June 2023|
[Make An Audio (ByteDance)](https://github.com/Text-to-Audio/Make-An-Audio)||[Github Pages](https://text-to-audio.github.io/)
[Hugging Face Spaces](https://huggingface.co/spaces/AIGC-Audio/Make_An_Audio)|[Github](https://github.com/Text-to-Audio/Make-An-Audio)|[Paper](https://text-to-audio.github.io/paper.pdf)||June 2023|
[Harmonai (Stability AI)](https://www.harmonai.org/)|Generate novel audio from pretrained models or fine-tune with your own audio tracks|[Hugging Face Spaces](https://huggingface.co/spaces/harmonai/dance-diffusion)
[24/7 Youtube stream](https://www.youtube.com/watch?v=kJgxC9d0p50)|[Dance Diffusion](https://colab.research.google.com/github/Harmonai-org/sample-generator/blob/main/Dance_Diffusion.ipynb)
[Fine-tuning Dance Diffusion](https://colab.research.google.com/github/Harmonai-org/sample-generator/blob/main/Finetune_Dance_Diffusion.ipynb)
[Github](https://github.com/Harmonai-org/sample-generator)|[Guide](https://drive.google.com/file/d/1nEFEpK27v0nytNXmmYQb06X_RI6kKPve/view)
[WandB article](https://wandb.ai/wandb_gen/audio/reports/A-Gentle-Introduction-to-Dance-Diffusion--VmlldzoyNjg1Mzky)|Non-coders (Hugging Face), coders (Google Colab)|Oct 2022|
[Jukebox (OpenAI)](https://openai.com/blog/jukebox/)|Choose artist, genre, lyrics, and generate audio|[Audio](https://jukebox.openai.com/)|[Google Colab](https://colab.research.google.com/github/openai/jukebox/blob/master/jukebox/Interacting_with_Jukebox.ipynb)|[Paper](https://arxiv.org/abs/2005.00341)|Coders (Google Colab)|April 2020|
**Generating MIDI(.mid files)**
[**MuseNet (OpenAI)**](https://openai.com/blog/musenet)|Generate new melodies(MIDI file). Scroll down to "Compose in the style of Chopin", generate a continuation of that song, and download the MIDI |[Audio](https://soundcloud.com/openai_audio/sets/musenet)|||Non-coders|Apr 2019|
[**Piano Transformer (Google)**](https://magenta.tensorflow.org/piano-transformer)|Generate piano MIDI notes from scratch or from a starting MIDI file|[Audio](https://magenta.tensorflow.org/assets/piano_transformer/clair_de_lune_continuation.mp3)|[Google Colab](https://colab.research.google.com/notebooks/magenta/piano_transformer/piano_transformer.ipynb)||Non-coders|Sep 2019|
**Other resources**
**MIDI(.mid files)**
[Basic Pitch (Spotify)](https://basicpitch.spotify.com)|Audio-to-MIDI converter with pitch bend detection. Record with your device, or upload an audio file to obtain a MIDI transcription||||Non-coders|June 2022|
[Magenta Studio (Google)](https://magenta.tensorflow.org/studio)|Compose multitrack melodies/chords in Ableton Live (music production software)||[Github](https://github.com/magenta/magenta-studio)||Ableton users, music producers|Feb 2019
[MIDI DDSP (Google Magenta)](https://magenta.tensorflow.org/midi-ddsp)|MIDI-to-Audio synthesis (expression control)|[Github Pages](https://midi-ddsp.github.io/)
[Blog](https://magenta.tensorflow.org/midi-ddsp)|[Github](https://github.com/magenta/midi-ddsp)|[Paper](https://openreview.net/pdf?id=UseMOjWENv)||Jan 2022|
[Hello Magenta (Google)](https://colab.research.google.com/notebooks/magenta/hello_magenta/hello_magenta.ipynb)|Introduction to Google Magenta - includes MelodyRNN and MusicVAE||[Google Colab](https://colab.research.google.com/notebooks/magenta/hello_magenta/hello_magenta.ipynb)
[Magenta.js](https://hello-magenta.glitch.me/)||Coders|
[Music Autobot](https://musicautobot.com)|Generate MIDI - song generation, harmonization, generating melodies, and remixing existing songs.||||Non-coders,non-musicians|
[FreeMIDI](https://freemidi.org/)|Download free MIDI files here||||Non-coders,non-musicians|
[Online Sequencer](https://onlinesequencer.net/)|Make your own MIDI file from scratch||||Non-coders,non-musicians|
**Audio(.wav or .mp3 files)**
[DDSP-VST (Google Magenta)](https://magenta.tensorflow.org/ddsp-vst)|DDSP morphs audio into a range of different instruments.|[Blog](https://magenta.tensorflow.org/ddsp)
[Page](https://magenta.tensorflow.org/ddsp-vst)|[Github](https://github.com/magenta/ddsp-vst)|[Paper](https://openreview.net/forum?id=B1x1ma4tDr)|Music producers|Jan 2020
[Spleeter by Deezer](https://deezer.io/releasing-spleeter-deezer-r-d-source-separation-engine-2b88985e797e)|Music source separation library. Upload an audio file, isolate vocals or instrumental||[Github](https://github.com/deezer/spleeter)
[Google Colab](https://colab.research.google.com/github/deezer/spleeter/blob/master/spleeter.ipynb)||Non-coders, coders|Nov 2019|
[GANSynth](https://magenta.tensorflow.org/gansynth)|Upload a MIDI file,download an audio file of the interpolation between different instruments|[Audio](https://storage.googleapis.com/magentadata/papers/gansynth/index.html)|[Google Colab](https://colab.research.google.com/notebooks/magenta/gansynth/gansynth_demo.ipynb)|[Paper](https://openreview.net/forum?id=H1xQVn09FX)|Non-coders|Feb 2019|
[MusicVAE (Google)](https://magenta.tensorflow.org/music-vae)|Generate audio, interpolate between 2 different melodies or drum beats |[Audio](https://magenta.tensorflow.org/assets/music_vae/mel_2bar-b2m.mp3)|[Google Colab](https://colab.research.google.com/notebooks/magenta/music_vae/music_vae.ipynb)|[Paper](https://arxiv.org/abs/1806.00195)|Non-coders|March 2018|
**Introduction to Music**||||||
[Chrome Music Lab](https://musiclab.chromeexperiments.com/Experiments)||||||
[Learning Music with Ableton](https://learningmusic.ableton.com/)||||||
[Learning Synths (Ableton)](https://learningsynths.ableton.com/)||||||
[Music Theory](https://www.musictheory.net/lessons/)||||||
**Miscellaneous**||||||
[Lyria (Google DeepMind)](https://deepmind.google/discover/blog/transforming-the-future-of-music-creation/)|AI Music Generation model used in Youtube's Dream Track for Shorts and AI Music Tools|[Youtube Blog](https://blog.youtube/inside-youtube/ai-and-music-experiment/)
[DeepMind Blog](https://deepmind.google/discover/blog/transforming-the-future-of-music-creation/)||||TBA
[Microsoft - Muzic](https://github.com/microsoft/muzic)|Research project on AI music that empowers music understanding and generation with deep learning and artificial intelligence||[Github](https://github.com/microsoft/muzic)
[Github Pages](https://ai-muzic.github.io/)|||
[NVIDIA - Maxine Audio Effects SDK](https://github.com/NVIDIA/MAXINE-AFX-SDK)|API Source Code and Sample Applications. Various audio effects for broadcast use cases with real-time audio processing||[Github](https://github.com/NVIDIA/MAXINE-AFX-SDK)
[NVIDIA Broadcast SDK](https://www.nvidia.com/en-au/geforce/broadcasting/broadcast-sdk/resources/)
[NVIDIA NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/maxine/collections/maxine)|||
[Google Magenta](https://magenta.tensorflow.org/)|Open source research project exploring the role of machine learning as a tool in the creative process|[Blog](https://magenta.tensorflow.org/blog)
[Talks](https://magenta.tensorflow.org/talks)
[Research](https://magenta.tensorflow.org/research)|[Github](https://github.com/magenta)
[Magenta Github](https://github.com/magenta/magenta)|||
[PapersWithCode - Music Generation](https://paperswithcode.com/task/music-generation)|Papers, code, evaluation papers, datasets|||||
[PapersWithCode - Music Source Separation](https://paperswithcode.com/task/music-source-separation)|Papers, code, evaluation papers, datasets|||||
[Python In Music](https://wiki.python.org/moin/PythonInMusic)|List of music software written in Python,music software supporting Python,music programming in Python, etc.|||||
[Github - Deep Learning for Music Generation by Carlos Hernández-Oliván](https://github.com/carlosholivan/DeepLearningMusicGeneration)|List of articles related to deep learning applied to music generation|||||
[Github - Deep Learning papers in music by Yann Bayle](https://github.com/ybayle/awesome-deep-learning-music)|List of articles related to deep learning applied to music|||||
[Github - Audio Development Tools by Yuan Man](https://github.com/Yuan-ManX/audio-development-tools)|List of sound, audio and music development tools||||
[TorchAudio](https://pytorch.org/audio/stable/index.html)|Library for audio and signal processing with PyTorch|||||
[Deep Learning with audio thread - Fast.AI forum](https://forums.fast.ai/t/deep-learning-with-audio-thread/38123)|List of links related to deep learning applied to audio|||||
[International Society for Music Information Retrieval(ISMIR)](https://www.ismir.net/resources/)|Links to datasets, educational material, tutorials, software related to music information retrieval|||||
[NLP4MusA Youtube channel](https://www.youtube.com/channel/UCtWGAGz6I_1aRetS8U4rYcA)|Natural Language Processing for Music and Audio - Zoom talks by NLP+music researchers|||||
[SigSep](https://sigsep.github.io/literature/)|Open resources for music source separation. Datasets, code, literature, tutorials||[Github](https://github.com/sigsep/open-unmix-pytorch)|||
[Google Experiments - Music](https://experiments.withgoogle.com/search?q=music)||||||