Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/NickTiny/blender-rhubarb-2d-lipsync
Blender Rhubarb 2D Lipsync is an addon for Blender integrating Rhubarb Lip Sync to animate 2D Mouths via Integer Properties.
https://github.com/NickTiny/blender-rhubarb-2d-lipsync
Last synced: 24 days ago
JSON representation
Blender Rhubarb 2D Lipsync is an addon for Blender integrating Rhubarb Lip Sync to animate 2D Mouths via Integer Properties.
- Host: GitHub
- URL: https://github.com/NickTiny/blender-rhubarb-2d-lipsync
- Owner: NickTiny
- Fork: true (scaredyfish/blender-rhubarb-lipsync)
- Created: 2022-05-06T22:01:33.000Z (about 2 years ago)
- Default Branch: develop
- Last Pushed: 2024-01-23T15:50:20.000Z (5 months ago)
- Last Synced: 2024-02-21T01:34:39.096Z (4 months ago)
- Language: Python
- Homepage:
- Size: 1.36 MB
- Stars: 10
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Lists
- Awesome-Daily - Rhubarb Lipsync
README
# Blender Rhubarb 2D Lipsync
[Get the Latest Release on Gumroad](https://tinynick.gumroad.com/l/uvsnj?layout=profile)
[Get the Latest Release Directly Here](https://github.com/NickTiny/blender-rhubarb-2d-lipsync/releases/tag/4.0.0)
[Rhubarb Lip Sync](https://github.com/DanielSWolf/rhubarb-lip-sync) is a command-line tool created by Daniel S. Wolf that automatically creates mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.
Blender Rhubarb Lipsync is an addon for Blender that integrates Rhubarb Lip Sync and uses it to generate mouth-shape keyframes from a pose library.
For support using this addon in Blender, please report an issue at
https://github.com/NickTiny/blender-rhubarb-2d-lipsync/issues
[Video Tutorial](https://www.youtube.com/embed/Anltf1_ufLQ "Rhubarb 2D Blender Tutorial by Tiny_Nick")
# Installation
Download a release from https://github.com/NickTiny/blender-rhubarb-2d-lipsync/releases. If you download or clone the repository, the Rhubarb Lip Sync executable and data files will be missing - they can be downloaded separately from the Rhubarb Lip Sync repository, and set up as described below under Usage.
Use version `4.0.0` with `Blender 3.0+`.
Do not unzip the file.
In Blender, open Blender Preferences Edit -> Preferences select Add-ons and choose Install.... In the file dialog, select the .zip file. Once installed, enable the add-on with the checkbox.
# Usage:
**Set Up Object**
For Time Offset types. Create a grease pencil object with the mouth shapes described in the Rhubarb Lip Sync documentation. You can set your poses on whatever frame you like. Add a Time Offset Modifier in Fixed mode to your grease pencil object.
**Set Executable**
Blender Rhubarb Lipsync includes the Rhubarb Lip Sync executable, but if you want to use a different executable, you can choose it in user preferences.
You can also set the recognizer here. PocketSphinx is recommended for English language, phonetic may give better results for other languages.
**Select a Target Type**
- Object will keyframe an integer/float property on the Object's Data.
- Time Offset will directly keyframe a Time Offset Modifier's Frame Offset.
- Bone will keyframe an interger or float property on the active Pose Bone.
**Set Target's Property**
Select the name of your Grease Pencil's Time Offset Modifier under Properties. Or the name of an integer/float property on the object/bone.
**Assign Mouth Values**
Set integers to match Rhubarb Lip Sync mouth shapes. Select your sound file, and dialog file (optional), and the start frame where your sound begins.
**Run Rhubarb LipSync**
Click the Rhubarb LipSync button and wait for the process to complete. The mouse cursor will change to a progress indicator, and your keyframes will appear when the process is complete.
# Troubleshooting
This software is pre-release and provided without support. In the event of problems, you can use the system console (Window->Toggle System Console on Windows, or start Blender from a command line on Mac/Linux) to get more info on progress and error messages. When reporting an issue, please include any errors reported here.
# Test Assets
[Test-Assets.zip](https://github.com/NickTiny/blender-rhubarb-2d-lipsync/files/10374071/Test-Assets.zip)
------------------
This is a fork of "Blender Rhubarb Lip Sync". Find [the original repo here](https://github.com/scaredyfish/blender-rhubarb-lipsync)