Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/thefloatingstring/copy-cast
A computer vision controlled hand exoskeleton. 2nd place at HackMIT 2022 (PRHI Challenge)
https://github.com/thefloatingstring/copy-cast
esp-32 opencv-python robotics
Last synced: 5 days ago
JSON representation
A computer vision controlled hand exoskeleton. 2nd place at HackMIT 2022 (PRHI Challenge)
- Host: GitHub
- URL: https://github.com/thefloatingstring/copy-cast
- Owner: TheFloatingString
- Created: 2022-10-01T19:17:57.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2023-06-13T05:23:38.000Z (over 1 year ago)
- Last Synced: 2024-11-13T20:16:29.837Z (2 months ago)
- Topics: esp-32, opencv-python, robotics
- Language: Python
- Homepage:
- Size: 4.08 MB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# copy-cast
### Service Architecture Diagram
https://github.com/TheFloatingString/repli.cate/blob/master/servarch.png
## Pitch Deck
https://app.pitch.com/app/player/b23306fb-f5f4-4258-a036-e4e6f119ad8a/87952341-b92a-49c3-87e1-84cd79705ac4
## What it looks like when someone uses it:
Exo skeletal gesture correction and visually guided training program based in OpenCV, and implemented using 3D printed retaining ring-and-link based mechanism and servo motors.
Also developed using the Qt Gui framework and a Flask webapp
The best of implementation of a tool like this is in the healthcare industry, with usecases being specialized invasive surgery training, as well as post treatment physiotherapy training of Parkinson's and Huntington's patients. Since we can't bring a live surgeon for in-person presentation, we had to find a use case for something like this. Along our research we found that, along with physical activities, one of the core principals of physiotherapy regimes like the ones we're talking about is engaging the mind while engaging the physical, including games into activities, or getting the patients to play musical instruments due to the special brain workout they provide. The use case we found viable for this presentation is a Piano.
## Quickstart
* Gesture detection web app:
```
pip install -r requirements.txt
python app.py
```
* The C++ code for the ESP-32 microcontroller is located in the `esp32` folder.
* A reflector server also needs to be set up (codebase available via this [GitHub repo](https://github.com/TheFloatingString/reflector-server))
# [HackMIT Submission](https://spectacle.hackmit.org/project/80)
# 2nd Prize in the Pittsburgh Health Safety Challenge
# Link to YouTube Demo (feat. Early Morning Background Singing)
https://www.youtube.com/watch?v=LeNInHSSqws