https://github.com/dfghiatus/vrcft-babble

Project Babble Module for VRCFaceTracking v5. An open-source VR mouth tracking solution
https://github.com/dfghiatus/vrcft-babble

ai babble computer-vision emotion emotion-classification emotion-detection emotion-recognition face-tracker face-tracking ml mouth mouth-detection mouth-tracking python python3 socket socket-programming vrchat vrchat-avatars

Last synced: about 12 hours ago
JSON representation

Project Babble Module for VRCFaceTracking v5. An open-source VR mouth tracking solution

• Host: GitHub
• URL: https://github.com/dfghiatus/vrcft-babble
• Owner: dfgHiatus
• License: mit
• Created: 2022-12-26T02:27:48.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-07-17T16:48:49.000Z (7 months ago)
• Last Synced: 2024-07-18T05:40:46.978Z (7 months ago)
• Topics: ai, babble, computer-vision, emotion, emotion-classification, emotion-detection, emotion-recognition, face-tracker, face-tracking, ml, mouth, mouth-detection, mouth-tracking, python, python3, socket, socket-programming, vrchat, vrchat-avatars
• Language: C#
• Homepage:
• Size: 49.8 KB
• Stars: 17
• Watchers: 1
• Forks: 6
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# VRCFT-Babble Module

[Project Babble](https://github.com/SummerSigh/ProjectBabble) Module for [VRCFaceTracking](https://github.com/benaclejames/VRCFaceTracking). An open-source VR mouth-tracking solution

![image](https://github.com/dfgHiatus/VRCFT-Babble/assets/51272212/90601f30-55a4-48af-a012-9cdb9bc47aa6)

## Installation instructions

1) Download and install [Project Babble](https://github.com/SummerSigh/ProjectBabble) and [VRCFaceTracking](https://github.com/benaclejames/VRCFaceTracking)

1) Download a copy of the latest release [here](https://github.com/dfgHiatus/VRCFT-Babble/releases/latest)

1) Drop the `VRCFaceTracking.Babble.dll` file in `AppData\Roaming\VRCFaceTracking\CustomLibs`. If this folder does not exist you can create it, VRCFaceTracking will create it on launch

1) Launch Project Babble, and set your outgoing port to 8888. You can do this via the GUI, or by editing the Python script directly. Also, be sure to orient your camera properly so your expressions aren't flipped in-game

1) Launch VRCFT (v5!)

1) Enable OSC in VRChat

1) Equip a face-tracking avatar (one with unified expressions)

1) Profit!

### Thanks to Summer#2406, Rames The Generic#3540, DenTechs#9511, PLYSHKA#6201, and benaclejames#6822 for helping me test, and encouraging me to do this!