https://github.com/haofanwang/visbeat3

Python3 Implementation for 'Visual Rhythm and Beat' SIGGRAPH 2018
https://github.com/haofanwang/visbeat3

colab jupyter-notebook python3 visbeat visbeat3

Last synced: 8 days ago
JSON representation

Python3 Implementation for 'Visual Rhythm and Beat' SIGGRAPH 2018

• Host: GitHub
• URL: https://github.com/haofanwang/visbeat3
• Owner: haofanwang
• License: other
• Created: 2022-03-22T10:56:15.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-05-31T03:03:04.000Z (over 2 years ago)
• Last Synced: 2024-10-07T18:38:36.932Z (about 1 month ago)
• Topics: colab, jupyter-notebook, python3, visbeat, visbeat3
• Language: Python
• Homepage:
• Size: 10.6 MB
• Stars: 17
• Watchers: 2
• Forks: 8
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# visbeat3

This is a migration of [visbeat](http://abedavis.com/visualbeat/) from Python2 to Python3. Head over to an example notebook on [Colab](https://colab.research.google.com/drive/1rYyhNtIsICk1osGrHMPr2zISwSIysCpT?usp=sharing)!



This work presents a visual analogue for musical rhythm derived from an analysis of motion in video, and shows that alignment of visual rhythm with its musical counterpart results in the appearance of dance. You can visit the official [project page](http://abedavis.com/visualbeat/) and [demos](http://abedavis.com/visualbeat/demo/) for more infos.

## Install

```

$ pip3 install visbeat3

```

## Usage

```

import os

import time

import matplotlib

import matplotlib.pyplot as plt

import numpy as np

import visbeat3 as vb

source_video = vb.PullVideo(name='video', source_location='./data/01.mp4')

# You can also directly specify an audio

# source_audio = vb.Audio('./data/all star.mp3')

source_audio = vb.PullVideo(name='audio', source_location='./data/02.mp4')

synch_video_beat = 0

synch_audio_beat = 0

nbeats = 32

output_path = './result.mp4'

# If source_audio is from an audio file, use target=source_audio 

warped = vb.Dancify(source_video=source_video, 

                    target=source_audio.getAudio(), 

                    synch_video_beat=synch_video_beat,

                    synch_audio_beat=synch_audio_beat, 

                    force_recompute=True, 

                    warp_type='quad',

                    nbeats=nbeats, 

                    output_path=output_path)

```

## Used By

[video-bgm-generation](https://github.com/wzk1015/video-bgm-generation): video background music generation.

## Reference

```

@inproceedings{davis2018visual,

  title={Visual rhythm and beat},

  author={Davis, Abe and Agrawala, Maneesh},

  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},

  pages={2532--2535},

  year={2018}

}

```