https://github.com/andrekovac/techfest2017
🕶 3D Mixed Reality Experience for the HoloLense to learn sign language
https://github.com/andrekovac/techfest2017
Last synced: 8 months ago
JSON representation
🕶 3D Mixed Reality Experience for the HoloLense to learn sign language
- Host: GitHub
- URL: https://github.com/andrekovac/techfest2017
- Owner: andrekovac
- License: mit
- Created: 2017-09-08T19:19:01.000Z (almost 9 years ago)
- Default Branch: master
- Last Pushed: 2018-12-04T22:38:37.000Z (over 7 years ago)
- Last Synced: 2024-01-30T10:31:15.975Z (over 2 years ago)
- Language: C#
- Homepage:
- Size: 89.2 MB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Virtual Sign Language Learning Environment
## About
A 3D Mixed Reality Experience for the [Microsoft HoloLense](https://www.microsoft.com/en-us/hololens) to learn sign language.
Learning a new sign is as easy as 1-2-3:
As in the video 1) the sign is demonstrated by the avatar, 2) demonstrated from your own perspective by the hands of the avatar and 3) repeated by the learner.
"Hello" gesture
### Motivation
YouTube videos can be misleading or error-prone when learning sign language because you always see the instructors hands back-to-front.
Therefore we created a mixed reality environment in which an avatar not only stands in front of you demonstrating the gesture, but also **moves his arms exactly there where your arms should go**. Now you can just repeat the movement the avatar did.
### Facts
* ✅ Interaction with friendly avatar.
* ✅ Shows gestures from your own perspective.
* Future🔮: Checks your hand-position with a kinect or a laser to check whether you did it right and to correct your mistakes.
## Further Example
How the sign for **"What's up?"** is learned:
"What's up?" gesture
### Technologies used
* [Microsoft HoloLense](https://www.microsoft.com/en-us/hololens)
* [Unity](https://unity3d.com/) Engine
* Motion Capture