https://github.com/trflorian/virtual-hand-clone

Virtual 3D clones of hands tracked by webcam.
https://github.com/trflorian/virtual-hand-clone

computer-vision deep-learning godot hand-tracking machine-learning python

Last synced: about 1 year ago
JSON representation

Virtual 3D clones of hands tracked by webcam.

• Host: GitHub
• URL: https://github.com/trflorian/virtual-hand-clone
• Owner: trflorian
• License: mit
• Created: 2024-06-30T14:35:03.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2024-07-07T21:18:15.000Z (almost 2 years ago)
• Last Synced: 2024-11-24T15:14:50.910Z (over 1 year ago)
• Topics: computer-vision, deep-learning, godot, hand-tracking, machine-learning, python
• Language: GDScript
• Homepage: https://medium.com/@flip.flo.dev/real-time-hand-tracking-in-godot-creating-virtual-3d-clones-of-my-hands-ecbfb73c2fcf
• Size: 31.3 KB
• Stars: 3
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Virtual Hand Clone

In this project I created a digital 3D clone of my hands with a single webcam. 

To track the hands, I use [mediapipe](https://mediapipe.readthedocs.io/en/latest/solutions/hands.html) with OpenCV and Python.

The identified hand landmark coordinates are then packaged and sent via UDP to [Godot](https://godotengine.org/), where the virtual hands are then visualized.

![godot_animation](https://github.com/trflorian/virtual-hand-clone/assets/27728267/c638b216-4504-4d40-95d9-c0420a96f819)

## ⚡ Quickstart

1. Clone the repo

2. Open the `python` folder and (optionally) create a virtual environment.

3. Install the dependencies from the requirements file with `pip install -r requirements.txt`

4. Run the python script `python hand_detection.py`

5. Open the Godot project in the `godot` folder in the Godot Game Engine.

6. Run the project.

## 🗞️ Tutorial

[Real-Time Hand Tracking in Godot — Creating Virtual 3D Clones of my Hands](https://medium.com/@flip.flo.dev/real-time-hand-tracking-in-godot-creating-virtual-3d-clones-of-my-hands-ecbfb73c2fcf)

## 🏗️ Architecture

![ArchitectureHandClone drawio](https://github.com/trflorian/virtual-hand-clone/assets/27728267/81ce01aa-d37e-46d8-bad4-6c65eae6936e)

## 🖥️ Versions

- Python 3.12.4

- OpenCV 4.10.0.84

- Mediapipe 0.10.14

- Godot v4.2.2

## 🎬 Demos

### Single Hand Tracking

![animation](https://github.com/trflorian/virtual-hand-clone/assets/27728267/b412dbdb-1082-450e-89dc-88f635e2bfd7)