An open API service indexing awesome lists of open source software.

https://github.com/shadmankhan/alexa-sign-lang-translator-tensorflow

alexa-sign-lang-translator-tensorflow
https://github.com/shadmankhan/alexa-sign-lang-translator-tensorflow

Last synced: 3 months ago
JSON representation

alexa-sign-lang-translator-tensorflow

Awesome Lists containing this project

README

        

# Making Alexa respond to Sign Language using Tensorflow.js

Run the demo in latest Chrome/Firefox to train the model using your own words and corresponding signs/gestures. If you have an Echo plugged in closeby, it should respond, otherwise simply play around and have fun. You will need to give permission to access your webcam and microphone.

## Running the code
To use the code, first install the JavaScript dependencies by running

```
npm install
```

Then start the local budo web server by running

```
npm start
```

This will start a web server on [`localhost:9966`](http://localhost:9966).

1. Allow permission to your webcam and microphone.

2. Add some words you want to train on.

## Reference
To learn more about the classifier used in this repo go to [KNN Image Classifier](https://github.com/PAIR-code/deeplearnjs/tree/master/models/knn_image_classifier)

There is a newer version of this classifier released in the new [tensorflow.js](https://js.tensorflow.org) which can be found [here](https://github.com/tensorflow/tfjs-models/tree/master/knn-classifier)