https://github.com/riffusion/riffusion-app

Stable diffusion for real-time music generation (web app)
https://github.com/riffusion/riffusion-app

ai audio diffusion music nextjs stable-diffusion threejs

Last synced: 3 months ago
JSON representation

Stable diffusion for real-time music generation (web app)

• Host: GitHub
• URL: https://github.com/riffusion/riffusion-app
• Owner: riffusion
• License: mit
• Created: 2022-11-20T19:20:04.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-07-22T18:01:37.000Z (4 months ago)
• Last Synced: 2024-08-18T15:11:07.100Z (3 months ago)
• Topics: ai, audio, diffusion, music, nextjs, stable-diffusion, threejs
• Language: TypeScript
• Homepage: https://riffusion.vercel.app
• Size: 30.6 MB
• Stars: 2,595
• Watchers: 37
• Forks: 185
• Open Issues: 20
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-ai-music-generation - riffusion-app - time music generation in a web app 🎵 (2474 stars) (GitHub projects)
• ai-game-devtools - Riffusion App - time music generation with stable diffusion. | | | Music | (<span id="music">Music</span> / <span id="tool">Tool (AI LLM)</span>)

README

        
# Riffusion App

:no_entry: This project is no longer actively maintained.

Riffusion is an app for real-time music generation with stable diffusion.

This repository contains the interactive web app that powers the website.

It is built with Next.js, React, Typescript, three.js, Tailwind, and Vercel.

## Run

This is a [Next.js](https://nextjs.org/) project bootstrapped with [`create-next-app`](https://github.com/vercel/next.js/tree/canary/packages/create-next-app).

First, make sure you have Node v18 or greater installed using `node --version`.

Install packages:

```bash

npm install

```

Run the development server:

```bash

npm run dev

# or

yarn dev

```

Open [http://localhost:3000](http://localhost:3000) with your browser to see the app.

The app home is at `pages/index.js`. The page auto-updates as you edit the file. The about page is at `pages/about.tsx`.

The `pages/api` directory is mapped to `/api/*`. Files in this directory are treated as [API routes](https://nextjs.org/docs/api-routes/introduction) instead of React pages.

## Inference Server

To actually generate model outputs, we need a model backend that responds to inference requests via API. If you have a large GPU that can run stable diffusion in under five seconds, clone and run the instructions in the [inference server](https://github.com/hmartiro/riffusion-inference) to run the Flask app.

You will need to add a `.env.local` file in the root of this repository specifying the URL of the inference server:

```

RIFFUSION_FLASK_URL=http://127.0.0.1:3013/run_inference/

```

## Citation

If you build on this work, please cite it as follows:

```

@article{Forsgren_Martiros_2022,

  author = {Forsgren, Seth* and Martiros, Hayk*},

  title = {{Riffusion - Stable diffusion for real-time music generation}},

  url = {https://riffusion.com/about},

  year = {2022}

}

```