Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/ozep/asl-interpreter

Hand tracking module empowered by OpenCV and MediaPy, customized to detect letters via sign language (ASL)
https://github.com/ozep/asl-interpreter

mediapy opencv-python pycharm python

Last synced: 4 days ago
JSON representation

Hand tracking module empowered by OpenCV and MediaPy, customized to detect letters via sign language (ASL)

Awesome Lists containing this project

README

        

# HandTracking (ASL Interpreter)

[23/12/2023] - Present

- Using OpenCV and MediaPy

https://github.com/oZep/HandTracking/assets/97713154/899c24fd-c1d9-43c3-a08b-800a034008db

# Main Idea
hand-landmarks

![image](https://github.com/oZep/HandTracking/assets/97713154/a7412c7e-72fe-49c8-8981-b5f996b71e01)

This module will help interpret these symbols and enable beginners to understand ASL instantly.

After the main ASL interpreter module is complete, I will take this project into the real world and decode ASL via Audio connected to a headset

## Progress
- Main Landmark Decoding Logic Complete
- Finished assigning Alphabet Landmarks it's correct POI (points of interest) and set up a way to have orientation of the hand be considered (ORT)
- Testing all characters, I found the program has issues distingishing between gestures that are very similar to eachother but very by lenght between landmarks, especially with C and O. I think calculating the distance between all hand landmarks will be the next step in making the system more precise.