https://github.com/alvinwan/sign-language-translator

Real-Time Sign Language Translation using Computer Vision
https://github.com/alvinwan/sign-language-translator

Last synced: 2 months ago
JSON representation

Real-Time Sign Language Translation using Computer Vision

• Host: GitHub
• URL: https://github.com/alvinwan/sign-language-translator
• Owner: alvinwan
• License: apache-2.0
• Created: 2019-11-29T01:55:51.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-01-27T01:11:55.000Z (almost 2 years ago)
• Last Synced: 2024-10-12T13:44:38.921Z (3 months ago)
• Language: Python
• Size: 420 KB
• Stars: 19
• Watchers: 2
• Forks: 16
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# How to Build a Neural Network to Translate Sign Language into English

Real-Time Sign Language Translation using Computer Vision

This repository includes all source code for the (soon-to-be) tutorial on DigitalOcean with the same title, including:

- A real-time sign language translator based on a live feed.

- Utilities used for portions of the tutorial, such as dataloaders.

- Simple convolutional neural network written in [PyTorch](http://pytorch.org), with pretrained model.

created by [Alvin Wan](http://alvinwan.com), November 2019





# Getting Started

For complete step-by-step instructions, see the (soon-to-be) tutorial on DigitalOcean. This codebase was developed and tested using `Python 3.6`. If you're familiar with Python, then see the below to skip the tutorial and get started quickly:

> (Optional) [Setup a Python virtual environment](https://www.digitalocean.com/community/tutorials/common-python-tools-using-virtualenv-installing-with-pip-and-managing-packages#a-thorough-virtualenv-how-to) with Python 3.6.

1. Install all Python dependencies.

```

pip install -r requirements.txt

```

2. Navigate into `src`.

```

cd src

```

3. Launch the script for a sign language translator:

```

python step_5_camera.py

```

# How it Works

See the below resources for explanations of related concepts:

- ["Understanding Least Squares"](http://alvinwan.com/understanding-least-squares/)

- ["Understanding Neural Networks"](http://alvinwan.com/understanding-neural-networks/)

## Acknowledgements

These models are trained on a Sign Language MNIST dataset curated by `tecperson`, as published on [Kaggle](https://www.kaggle.com/datamunge/sign-language-mnist).