https://github.com/s-soltys/lipsync

Lip animation app for 3D face models.
https://github.com/s-soltys/lipsync

Last synced: about 2 months ago
JSON representation

Lip animation app for 3D face models.

• Host: GitHub
• URL: https://github.com/s-soltys/lipsync
• Owner: s-soltys
• License: unlicense
• Created: 2015-12-28T20:50:58.000Z (almost 9 years ago)
• Default Branch: master
• Last Pushed: 2015-12-28T21:37:23.000Z (almost 9 years ago)
• Last Synced: 2023-02-27T16:46:20.682Z (almost 2 years ago)
• Language: ActionScript
• Size: 364 KB
• Stars: 18
• Watchers: 3
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# LipSync

This application generates real-time facial animations for 3D models based on input sound files.

A short presentation can be seen on my YouTube channel:

https://youtu.be/I08ZYTYpRis

## How it works

The application works in several steps:

1. Load speech samples in windows up to 30 ms

2. Extract features from the sample windows using linear prediction

3. Classify extracted feature blocks to visemes using neural networks

4. Animate the 3D model using viseme data

## Further reading

https://en.wikipedia.org/wiki/Linear_prediction

https://en.wikipedia.org/wiki/Viseme