Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/haofanwang/visbeat3
Python3 Implementation for 'Visual Rhythm and Beat' SIGGRAPH 2018
https://github.com/haofanwang/visbeat3
colab jupyter-notebook python3 visbeat visbeat3
Last synced: about 2 months ago
JSON representation
Python3 Implementation for 'Visual Rhythm and Beat' SIGGRAPH 2018
- Host: GitHub
- URL: https://github.com/haofanwang/visbeat3
- Owner: haofanwang
- License: other
- Created: 2022-03-22T10:56:15.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2022-05-31T03:03:04.000Z (over 2 years ago)
- Last Synced: 2024-10-07T18:38:36.932Z (3 months ago)
- Topics: colab, jupyter-notebook, python3, visbeat, visbeat3
- Language: Python
- Homepage:
- Size: 10.6 MB
- Stars: 17
- Watchers: 2
- Forks: 8
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# visbeat3
This is a migration of [visbeat](http://abedavis.com/visualbeat/) from Python2 to Python3. Head over to an example notebook on [Colab](https://colab.research.google.com/drive/1rYyhNtIsICk1osGrHMPr2zISwSIysCpT?usp=sharing)!
This work presents a visual analogue for musical rhythm derived from an analysis of motion in video, and shows that alignment of visual rhythm with its musical counterpart results in the appearance of dance. You can visit the official [project page](http://abedavis.com/visualbeat/) and [demos](http://abedavis.com/visualbeat/demo/) for more infos.
## Install
```
$ pip3 install visbeat3
```## Usage
```
import os
import timeimport matplotlib
import matplotlib.pyplot as pltimport numpy as np
import visbeat3 as vbsource_video = vb.PullVideo(name='video', source_location='./data/01.mp4')
# You can also directly specify an audio
# source_audio = vb.Audio('./data/all star.mp3')
source_audio = vb.PullVideo(name='audio', source_location='./data/02.mp4')synch_video_beat = 0
synch_audio_beat = 0
nbeats = 32output_path = './result.mp4'
# If source_audio is from an audio file, use target=source_audio
warped = vb.Dancify(source_video=source_video,
target=source_audio.getAudio(),
synch_video_beat=synch_video_beat,
synch_audio_beat=synch_audio_beat,
force_recompute=True,
warp_type='quad',
nbeats=nbeats,
output_path=output_path)
```## Used By
[video-bgm-generation](https://github.com/wzk1015/video-bgm-generation): video background music generation.## Reference
```
@inproceedings{davis2018visual,
title={Visual rhythm and beat},
author={Davis, Abe and Agrawala, Maneesh},
booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},
pages={2532--2535},
year={2018}
}
```