https://github.com/daaanishhh002/signwave
This repository contains code for a real-time hand gesture recognition system using flex sensors and an IMU6050 sensor in gloves. It translates sign language gestures into text and converts them to speech.
https://github.com/daaanishhh002/signwave
android-application esp32 flask java random-forest-classifier websocket
Last synced: over 1 year ago
JSON representation
This repository contains code for a real-time hand gesture recognition system using flex sensors and an IMU6050 sensor in gloves. It translates sign language gestures into text and converts them to speech.
- Host: GitHub
- URL: https://github.com/daaanishhh002/signwave
- Owner: daaanishhh002
- Created: 2024-12-30T16:05:00.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-01-07T15:59:27.000Z (over 1 year ago)
- Last Synced: 2025-03-04T16:16:50.640Z (over 1 year ago)
- Topics: android-application, esp32, flask, java, random-forest-classifier, websocket
- Language: Jupyter Notebook
- Homepage:
- Size: 384 KB
- Stars: 0
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
🖐️ SignWave - Where Gestures Speak Volumes 🤖🎤
Welcome to the **Hand Gesture Recognition System**! 🚀 This project aims to **bridge communication gaps** by recognizing sign language gestures in **real-time** using **flex sensors** and an **IMU6050** sensor embedded in gloves. The system translates gestures into **text** and converts them to **speech** for better accessibility. 🎙️💬
---
## 📌 Features
✔️ **Real-time gesture recognition** using sensor-based gloves
✔️ **Sign language to text** conversion 📝
✔️ **Text-to-speech (TTS) integration** 🔊
✔️ **Machine Learning for accurate classification** 🤖
✔️ **Potential NLP and online learning enhancements**
✔️ **Cloud deployment on AWS EC2 (planned)** ☁️
---
## 🛠️ Hardware Used
The following components are used to build the **gesture recognition glove**:
| 🔧 Component | 🏷️ Description |
|--------------|-------------|
| 🧤 **Glove** | Base for mounting sensors |
| 🏗️ **Flex Sensors** | Detects finger bending |
| 🎯 **IMU6050 (Accelerometer + Gyroscope)** | Tracks hand motion and orientation |
| 🔌 **ESP32** | Microcontroller for processing signals |
| 📱 **Smart Phone** | Converts text to speech |
| 🌐 **AWS EC2 (Future)** | Cloud-based processing |
---
## 🖥️ Software & Libraries
📌 **Programming Languages:**
- Python 🐍
- C++ (for microcontroller programming)
📌 **Libraries & Dependencies:**
- `numpy` ➜ Data processing
- `scikit-learn` ➜ Machine Learning model
- `TensorFlow / PyTorch` ➜ (Future deep learning integration)
- `speechRecognition` ➜ Text-to-Speech conversion
- `Flask` ➜ Websocket-based data transfer
- `AWS SDK` ➜ Cloud deployment
---
## 🚀 How It Works
1️⃣ **Sensors detect gestures:**
- **Flex sensors** measure finger bending angles
- **IMU6050** tracks hand movements
2️⃣ **Data Processing:**
- Sensor data is sent to a **microcontroller**
- Features are extracted and sent to a **gesture classification model**
3️⃣ **Classification:**
- Machine Learning model **predicts the gesture**
- Text output is generated
4️⃣ **Speech Conversion:**
- The text is passed through a **Text-to-Speech (TTS) engine**
- The recognized word/sentence is **spoken aloud** 🔊
---
## 🛠️ Installation & Setup
1️⃣ **Clone the Repository**
```bash
git clone https://github.com/daaanishhh002/SignWave.git
cd SignWave
```
2️⃣ **Install Dependencies**
```bash
pip install -r requirements.txt
```
### 🌍 Future Enhancements
✨ Deep Learning Model for improved accuracy
✨ Real-time Streaming for live sign language translation
✨ NLP-based contextual learning
✨ AWS Cloud Integration for remote accessibility
### 📜 License
This project is open-source under the MIT License. Feel free to modify and contribute! 🎉
### 📞 Contact
💡 Authors: Danish Ahmed, Syed Zeeshan, Syed Mubeen Ali, Shaik Abdul Sami
📧 Email: ahmed.daanish002@gmail.com
🐙 GitHub: daaanishhh002
🌟 If you like this project, give it a star ⭐ on GitHub!