https://github.com/robo-linkers/gesture-controlled-robotic-arm
3 DOF Gesture controlled robotic arm
https://github.com/robo-linkers/gesture-controlled-robotic-arm
embedded-systems esp32 iort iot iot-application power-electronics robotic robotic-arm robotics
Last synced: 30 days ago
JSON representation
3 DOF Gesture controlled robotic arm
- Host: GitHub
- URL: https://github.com/robo-linkers/gesture-controlled-robotic-arm
- Owner: Robo-Linkers
- License: mit
- Created: 2025-02-21T04:33:18.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2025-05-24T12:06:15.000Z (5 months ago)
- Last Synced: 2025-05-24T12:30:46.414Z (5 months ago)
- Topics: embedded-systems, esp32, iort, iot, iot-application, power-electronics, robotic, robotic-arm, robotics
- Language: C++
- Homepage:
- Size: 47.6 MB
- Stars: 2
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
README
Mudra MK-I
📚 Table of Contents (Click to Expand)
- [📖 Project Description](#-project-description)
- [✨ Features](#-features)
- [⚙️ Installation Instructions](#️-installation-instructions)
- [🦾 Project Showcase](#-project-showcase)
- [🔧 Use Cases](#-use-cases)
- [🛣️ Future Plans](#️-future-plans)
- [🤝 Contributing](#-contributing)
- [📜 License](#-license)
- [🙏 Acknowledgments](#-acknowledgments)
- [🤖 Meet the Team! 🤝](#-meet-the-team-)
- [📧 Contact Information](#-contact-information)
- [📝 Attribution](#-attribution)
---
## 📖 Project Description
**Mudra MK-Ⅰ** is a **gesture-controlled robotic arm** developed as an educational and research initiative. It is engineered to automate repetitive tasks through intuitive **hand gestures**, making it ideal for learning environments and experimentation in human-machine interaction.
The robotic arm features a **four-link structure** - comprising a **base, two articulated links, and an end effector** - enabling reliable **pick-and-place functionality**.
Control is facilitated through a **wearable glove interface**, equipped with **flex sensors** and an **accelerometer**, which translate real-time hand movements into precise robotic actions.
🌱 Mudra MK-Ⅰ marks the beginning of our journey as a student innovation team. As our very first project, it represents not just technical achievement, but a shared vision — to explore, learn, and build solutions that bridge creativity and engineering. This is the foundation upon which future ideas will grow.
---
## ✨ Features
🤖 4-Link Robotic Arm Structure
➤ Enables precise and flexible movement
🖐️ Gesture-Based Control
➤ Uses flex sensors and an accelerometer for intuitive interaction
📦 Pick-and-Place Functionality
➤ Automates repetitive tasks with ease
🧭 Intuitive User Interface
➤ Offers seamless and user-friendly control
> **Note:**
> The integration of a 4th link between the end effector and the robotic arm is part of our planned system expansion.
> In the current release, the design has been optimized for stability, ease of control, and project timelines.
> Full 4-link integration, offering enhanced dexterity and extended functionality, is scheduled for future updates.
> Further design considerations and future rollout details are outlined in the [DESIGN.MD](./designs/DESIGN.MD) file.
---
## ⚙️ Installation Instructions
- 🛠️ For installation instructions and to download the Arduino IDE, visit the [Arduino IDE Download Page](https://www.arduino.cc/en/software).
- Add the ESP32 Library to the ide [Instructions](https://docs.espressif.com/projects/arduino-esp32/en/latest/installing.html)
- To set up the project, follow these steps:
- Clone the repository:
- ```bash
git clone https://github.com/Robo-Linkers/Gesture-controlled-robotic-arm.git
```
- Install any necessary dependencies [REQUIREMENTS](requirements.txt)
- Navigate to the project directory:
- `cd Gesture-controlled-robotic-arm`
- In the `src` folder, you will find two Arduino code files: `Glove.ino` and `Power_Drive.ino`.
- Upload `Glove.ino` to the ESP32 board that handles gesture recognition.
- Upload `Power_Drive.ino` to the ESP32 board that controls the robotic arm's movements.
- Before uploading the codes to the boards, make sure to:
- Edit the relevant fields in both files:
- Set your WiFi SSID and Password in the code.
- Adjust any other parameters as necessary for your setup (e.g., GPIO pins, motor controls).
Once you've uploaded both codes to the respective boards, your setup should be ready for further testing.
- For building the hardware and assembling the robotic arm, refer to the detailed setup and wiring instructions in the [DESIGN.MD](./designs/DESIGN.MD) file. This includes schematics, PCB & hardware designs, and wiring connections necessary to physically construct the system.
---
## 🚀 Usage Instructions
- After setting up the hardware and software, wear the glove equipped with sensors, power on the robotic arm, and start performing gestures to control its movements.
### Components
- Robotic Arm: 4-link structure with servos.
- Glove Interface: Equipped with flex sensors and an accelerometer
- Microcontroller: ESP32 or compatible board for processing input signals
- Power Supply: AC power source for operation.
### Designs
- For detailed information on the setup, schematics, and design documents related to the glove and robotic arm, refer to the Design Folder. It includes all the necessary diagrams and documentation to help you build the physical system and understand the circuitry.
### Testing
- The tests folder contains Arduino sketches for testing individual components, including:
- Flex sensors
- Dual MPU6050
- Power electronics (motors, servos)
- If you encounter any errors, test each component individually to identify the source of the issue.
> It is **highly recommended** to test each component individually before full assembly to ensure everything is working correctly and to avoid complications during the final integration.
---
## 📂 Folder Structure
```bash
Gesture-controlled-robotic-arm/
│ .gitattributes
│ .gitignore
│ CONTRIBUTING.md
│ LICENSE
│ README.md
│ requirements.txt
│
├───assets
│ ├───icons
│ │ 3-dof-arm.png
│ │ bill.png
│ │ binary-code.png
│ │ docs.png
│ │ pcb-board.png
│ │ schematic.png
│ │ testing.png
│ │
│ └───images
│ feature-excluded.png
│ mechanical-assembly-ss-front.png
│ mechanical-assembly-ss.png
│ robotic-arm-front-view.jpg
│ robotic-arm-glove.jpg
│ robotic-arm-side-view.jpg
│ Screenshot 2025-02-11 091135.png
│ Screenshot 2025-02-11 091319.png
│
├───designs
│ │ BASE v14.step
│ │ Bill_of_Materials_Electrical.pdf
│ │ Bill_of_Materials_Mechanical.pdf
│ │ BOM.MD
│ │ DESIGN.MD
│ │ Schematic_Glove-Gesture-Controlled-Robotic-Arm_2025-04-26.pdf
│ │ Schematic_Power-Drive-Gesture-Controlled-Robotic-Arm_2025-04-26.pdf
│ │
│ └───Solid-edge
│ BASE-v14-solid-edge.asm
│ BASE-v14-solid-edge.cfg
│
├───src
│ Glove.ino
│ Power_Drive.ino
│
└───tests
│ TESTS.MD
│
├───Embedded Systems
│ ├───COMPLETE
│ │ COMPLETE.ino
│ │
│ ├───DUAL-MPU6050
│ │ DUAL-MPU6050.ino
│ │
│ └───FLEX-SENSORS
│ FLEX-SENSORS.ino
│
└───Power Electronics
├───complete
│ complete.ino
│
├───complete-dynamic
│ complete-dynamic.ino
│
├───nema_17_test
│ nema_17_test.ino
│
└───servo_test
servo_test.ino
.
```
---
## 🦾 Project Showcase
---
## 🔧 Use Cases
💡 **Manufacturing** → Automating repetitive tasks like assembly & packaging
🔧 **Remote Operation in Hazardous Environments** → Safely handling objects in high-risk areas such as labs or hot zones using remote gesture control
🎓 **Education** → Demonstrating robotics concepts in academic settings
🧪 **Research** → Exploring human-robot interaction and automation
---
## 🛣️ Future Plans
- 🚀 **Integrate the 4th Link**
- Expand the robotic arm with a fourth link between the end effector and arm base to improve dexterity and range of motion.
- 🚀 **Enhance Gesture Recognition**
- Implement advanced gesture processing algorithms for more fluid and natural control.
- 🚀 **Wireless Communication Optimization**
- Improve reliability and response time of the ESP32-based communication system.
- 🚀 **Battery Power Support**
- Add portable power options to make the system independent of a fixed AC supply and make a rechargeable solution for glove.
- 🚀 **Vision-Based Object Tracking**
- Future iterations may incorporate a lightweight camera module for autonomous object detection and tracking.
- 🚀 **Mechanical Redesign**
- Refine the mechanical structure for lighter weight and increased durability, including 3D printed or CNC-milled parts.
---
## 🤝 Contributing
- Contributions are welcome! Please feel free to submit a pull request or open an issue if you have suggestions or improvements, for more details refer [CONTRIBUTING](CONTRIBUTING.md).
---
## 📜 License
This project is licensed under the **MIT License**. Refer to the [LICENSE](LICENSE) file for more details.
---
## 🙏 Acknowledgments
> Engineered by Robo-Linkers 🤖 2025
### 🤖 Meet the Team! 🤝
- [Namitha Madhu](https://www.linkedin.com/in/namitha-madhu-4934a8276/) - Embedded Lead 🚀
- [Madhubala M](https://www.linkedin.com/in/madhubala-m-0b66752bb/) - Embedded Co-Lead 💡
- [Bhagyashree M](https://www.linkedin.com/in/bhagyashree-m-a21853343/) - Hardware Integration Engineer
- [Keerthivasan](https://www.linkedin.com/in/keerthivasansv/) - The Code Wizard 🧙♂️
- [Gomathi Manisha](https://www.linkedin.com/in/gomathi-manisha-a-3894b8285) - Project Co-Lead 🚀
- [Anmol Krishnan](https://www.linkedin.com/in/anmolkrish/) - Project Lead and Power Electronics Lead ⚡️
- [Shivani K.C](https://www.linkedin.com/in/shivani-k-c-543513276/) - Power Electronics Co-Lead ⚡️
- [Mithill Prabhu](https://www.linkedin.com/in/mithill-prabhu/) - Design Lead ⚙️
---
## 📧 Contact Information
- For any inquiries or feedback, please contact us at [GitHub](https://github.com/Robo-Linkers/Gesture-controlled-robotic-arm), [GitLab](https://gitlab.com/robo-linkers/Gesture-controlled-robotic-arm)
---
## 📝 Attribution
Robot icons created by Freepik - Flaticon
Invoice icons created by Freepik - Flaticon
Coding icons created by Freepik - Flaticon
Document icons created by Freepik - Flaticon
Pcb board icons created by madness - Flaticon
Schematic icons created by Iconjam - Flaticon
Software development icons created by kliwir art - Flaticon