https://github.com/fantasy-fish/Generalized-Speech-Animation

USC CS621 Course Project
https://github.com/fantasy-fish/Generalized-Speech-Animation

Last synced: about 16 hours ago
JSON representation

USC CS621 Course Project

• Host: GitHub
• URL: https://github.com/fantasy-fish/Generalized-Speech-Animation
• Owner: fantasy-fish
• Created: 2018-08-28T09:44:55.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2023-04-22T20:33:33.000Z (about 1 year ago)
• Last Synced: 2024-03-05T23:32:14.263Z (4 months ago)
• Language: Jupyter Notebook
• Size: 6.17 MB
• Stars: 26
• Watchers: 2
• Forks: 9
• Open Issues: 3
• Metadata Files:
  • Readme: README.md

Lists

• awesome-stars - Generalized-Speech-Animation - fish | 24 | (Jupyter Notebook)

README

        
# Generalized-Speech-Animation

USC CS621 Course Project

Implementation of "A Deep Learning Approach for Generalized Speech Animation" based on tensorflow


Use the Penn Phonetics Lab Forced Aligner (P2FA) to extract phonemetic labels


Use the flame-fitting method for 2d-to-3d mapping ("FLAME, a lightweight and expressive generic face model")


Use menpo to train the AAM model; this part is under the utilities folder

Requirements:

* tensorflow

* menpo

Below is a simple demo video:


[![IMAGE ALT TEXT HERE](https://img.youtube.com/vi/rIueI1imqPA/0.jpg)](https://www.youtube.com/watch?v=rIueI1imqPA)