Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/mikaelalafriz/lucid-sonic-dreams

Last synced: 3 months ago
JSON representation

Host: GitHub
URL: https://github.com/mikaelalafriz/lucid-sonic-dreams
Owner: mikael-alafriz-deel
License: mit
Created: 2021-03-13T09:09:22.000Z (over 3 years ago)
Default Branch: main
Last Pushed: 2021-09-18T16:07:26.000Z (about 3 years ago)
Last Synced: 2024-04-13T20:15:39.186Z (7 months ago)
Language: Python
Size: 43 KB
Stars: 771
Watchers: 24
Forks: 156
Open Issues: 44
Metadata Files:
- Readme: README.md
- License: LICENSE.txt

Awesome Lists containing this project

awesome-generative-ai - mikaelalafriz/lucid-sonic-dreams - generated visuals to music (Image Synthesis / AI Tools for Searching)

README

# Lucid Sonic Dreams
Lucid Sonic Dreams syncs GAN-generated visuals to music. By default, it uses [NVLabs StyleGAN2](https://github.com/NVlabs/stylegan2), with pre-trained models lifted from [Justin Pinkney's consolidated repository](https://github.com/justinpinkney/awesome-pretrained-stylegan2). Custom weights and other GAN architectures can be used as well.

Sample output can be found on [YouTube](https://youtu.be/l-nGC-ve7sI) and [Instagram](https://www.instagram.com/lucidsonicdreams/).

## Installation

This implementation has been teston on Python 3.6 and 3.7. As per NVLabs' TensorFlow implementation of StyleGAN2, TensorFlow 1.15 is required. TensorFlow 2.x is not supported.

To install, simply run:

```pip install lucidsonicdreams```

## Usage

You may refer to the [Lucid Sonic Dreams Tutorial Notebook](https://colab.research.google.com/drive/1Y5i50xSFIuN3V4Md8TB30_GOAtts7RQD?usp=sharing) for full parameter descriptions and sample code templates. A basic visualization snippet is also found below.

### Basic Visualization

```
from lucidsonicdreams import LucidSonicDream

L = LucidSonicDream(song = 'song.mp3',
style = 'abstract photos')

L.hallucinate(file_name = 'song.mp4')
```