An open API service indexing awesome lists of open source software.

https://github.com/rathod-shubham/mediapipe_gestures

Project uses MediaPipe to recognize and track hand gestures from both live video and images. By identifying 3D hand landmarks in real time, it enables intuitive gesture-based control. Have successfully applied this in robotics where a robotic arm mirrors human hand movements demonstrating its potential for interactive and touchless control systems.
https://github.com/rathod-shubham/mediapipe_gestures

cv2 gesture-recognition livestream mediapipe python3 robotics tracking

Last synced: 4 months ago
JSON representation

Project uses MediaPipe to recognize and track hand gestures from both live video and images. By identifying 3D hand landmarks in real time, it enables intuitive gesture-based control. Have successfully applied this in robotics where a robotic arm mirrors human hand movements demonstrating its potential for interactive and touchless control systems.

Awesome Lists containing this project

README

          

# MediaPipe_Gestures

# ๐Ÿ–๏ธ Hand Gesture Recognition and Tracking using MediaPipe

This repository contains Python code that leverages **Googleโ€™s MediaPipe** to recognize and track hand gestures from both live camera streams and static images.

Using real-time hand landmark detection, the system can track individual fingers, detect various hand poses, and interpret gestures that can be used in a wide range of applications.

---

## ๐Ÿ” Overview

At the core of this project is MediaPipeโ€™s **Hand Tracking solution**, which provides 21 3D landmarks per detected hand with high accuracy and real-time performance. This enables gesture classification, pose estimation, and motion tracking with minimal setup.

The code in this repository supports:
- ๐ŸŽฅ Real-time gesture recognition using live video streams
- ๐Ÿ–ผ๏ธ Gesture detection from saved images
- โœจ Preprocessing and annotation utilities for visualization

---

## ๐Ÿค– Applications

Hand gesture recognition has wide applicability across domains such as:
- **Human-computer interaction**
- **Sign language interpretation**
- **AR/VR input systems**
- **Touchless interfaces**
- **Gaming and immersive environments**

### ๐Ÿš€ Use Case in Robotics

I integrated this system into a **robotics project** where a **robotic arm mimicked human hand movements** in real-time. Using the detected hand landmarks, joint angles were inferred and relayed to the robot's servos, enabling intuitive and natural gesture-based control.

---

## ๐Ÿ› ๏ธ Tech Stack

- ๐Ÿ **Python 3**
- ๐Ÿชž **MediaPipe Hands** solution
- ๐ŸŽฅ **OpenCV** for real-time video handling and visualization

---

## ๐Ÿ“ Contents

- `LiveSteam` โ€“ Detect and visualize hand gestures in real-time from webcam
- `Image` โ€“ Perform gesture recognition on static images
- Utility scripts and drawing helpers

---