https://github.com/zak-45/wledlipsync
Lip Sync Tool
https://github.com/zak-45/wledlipsync
animatronic audio-analysis chataigne lipsync nicegui portable rhubarb spleeter wled
Last synced: 2 months ago
JSON representation
Lip Sync Tool
- Host: GitHub
- URL: https://github.com/zak-45/wledlipsync
- Owner: zak-45
- License: mit
- Created: 2024-10-17T09:36:35.000Z (12 months ago)
- Default Branch: main
- Last Pushed: 2025-01-30T22:36:32.000Z (8 months ago)
- Last Synced: 2025-05-21T13:18:30.556Z (5 months ago)
- Topics: animatronic, audio-analysis, chataigne, lipsync, nicegui, portable, rhubarb, spleeter, wled
- Language: JavaScript
- Homepage:
- Size: 95.2 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Lip Sync tool , audio analysis separate into stems by Spleeter.
Generate lip sync information by Rhubarb.
Send data to Chataigne: can be used for e.g. audio animatronic.
Send data to WLEDVideoSync: easy singing face for 2D matrix e.g: WLED
Cross-Platform (Win / Linux / macOS) Portable Application
```
13/12/2024
This is a BETA release. Tested on Win / Linux. All main features there.
No python installation required.
Portable version provide you flexibility with nothing installed into your OS.
```
## WLEDLipSync
WLEDVideoSync is a tool designed to create singing face seen on 2D matrix e.g. WLED. Can be used for audio animatronic project.
**Key Features:**
- Audio separation into stems ( vocals / accompaniment )
- Audio analysis with mouth cue creation
- Integrated with Chataigne (portable version included)
- OSC message
- Integrated with WLEDVideoSync (need to be installed separately)
- Websocket message
**Portable Installation:**
1. Take the app from releases (Unix/ Mac/ Win)
2. --> On Mac/Linux: chmod +x WLEDLipSync
3. Execute it to extract the standalone version
4. Go to ./WLEDLipSync folder and run WLEDLipSync-{OS}(exe/bin) app.
5. --> On Mac/Linux: chmod +x WLEDLipSync-{OS} should be necessary