https://github.com/zabot/handy
An American sign language recognizer using the leap motion controller
https://github.com/zabot/handy
Last synced: 3 months ago
JSON representation
An American sign language recognizer using the leap motion controller
- Host: GitHub
- URL: https://github.com/zabot/handy
- Owner: Zabot
- License: gpl-3.0
- Created: 2016-03-13T13:24:27.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2016-03-15T21:48:33.000Z (about 9 years ago)
- Last Synced: 2025-01-25T09:42:18.556Z (4 months ago)
- Language: C++
- Homepage:
- Size: 746 KB
- Stars: 1
- Watchers: 4
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Handy
An American sign language recognizer using the Leap Motion controller
- Recognizes the American sign language alphabet
- Presents a word to be signed to the Leap Motion
- Adaptively recognizes similar signs depending on context
# Theory
Several sign language letters are unique in number and type
of fingers extended, e.g. L is a thumb and index finger
while B is all four fingers. By recognizing which fingers
are extended we narrow the number of possible signs,
continuing until a single sign is reached or there are
multiple signs using the same fingers. These signs are
differentiated using unique key points on each sign,
such as the distance between the tip of the index and middle
finger to determine V or R/U, and the angle between the fingers
to separate R and U.
Some similar letters, such as T and N are difficult to tell apart.
There is a configurable list of similar letters that is used
to resolve this ambiguity, allowing letters to be used in
place of each other depending on context.
# Compilation
Compiles using cmake and make on Linux
- Requires Leap SDK (Set environment variable `LEAP_SDK` to the sdk directory)
- Requires Qt5
mkdir build
cd build
cmake ..
make
# Usage
Navigate to build directory
./signLanguage