https://github.com/cj-mills/fastai-asl-classification-webgl-demo
An American Sign Language (ASL) classifier WebGL demo for the fastai to Unity tutorial
https://github.com/cj-mills/fastai-asl-classification-webgl-demo
Last synced: 7 months ago
JSON representation
An American Sign Language (ASL) classifier WebGL demo for the fastai to Unity tutorial
- Host: GitHub
- URL: https://github.com/cj-mills/fastai-asl-classification-webgl-demo
- Owner: cj-mills
- License: mit
- Created: 2022-06-02T01:52:00.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-09-22T23:41:30.000Z (about 3 years ago)
- Last Synced: 2025-01-12T13:29:04.143Z (9 months ago)
- Language: HTML
- Homepage: https://cj-mills.github.io/Fastai-ASL-Classification-WebGL-Demo/
- Size: 90.5 MB
- Stars: 7
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Fastai ASL Classification WebGL Demo
An American Sign Language (ASL) classifier WebGL demo for the fastai to Unity tutorial
### Live Demo: [https://cj-mills.github.io/Fastai-ASL-Classification-WebGL-Demo/](https://cj-mills.github.io/Fastai-ASL-Classification-WebGL-Demo/)
### Kaggle Dataset: [belalelwikel/asl-and-some-words](https://www.kaggle.com/datasets/belalelwikel/asl-and-some-words)
Reference Images
| Class | Image |
| --------- | ------------------------------------------------------------ |
| 0_OR_O |  |
| 1 |  |
| 2_OR_V |  |
| 3 |  |
| 4 |  |
| 5 |  |
| 6_OR_W |  |
| 7 |  |
| 8 |  |
| 9 |  |
| A |  |
| B |  |
| C |  |
| D |  |
| E |  |
| F |  |
| G |  |
| H |  |
| I |  |
| J |  |
| K |  |
| L |  |
| M |  |
| N |  |
| O_OR_0 |  |
| P |  |
| Q |  |
| R |  |
| S |  |
| T |  |
| U |  |
| V_OR_2 |  |
| W_OR_6 |  |
| X |  |
| Y |  |
| Z |  |
| Baby |  |
| Brother |  |
| Dont_Like |  |
| Friend |  |
| Help |  |
| House |  |
| Like |  |
| Love |  |
| Make |  |
| More |  |
| Name |  |
| No |  |
| Pay |  |
| Play |  |
| Stop |  |
| With |  |
| Yes |  |
| nothing |  |
Performance Observations
| OS | Browser | Hardware | Model | Input | FPS | Notes |
| ---------- | ------- | ----------------------- | -------- | ---------- | ------------- | ------------------------------------------------------------ |
| Windows 10 | Chrome | Titan RTX | ResNet34 | test image | 60 (capped) | Model returns accurate results |
| Windows 10 | Chrome | Titan RTX | ResNet34 | webcam | 45-55 | Model returns accurate results |
| Windows 10 | Firefox | Titan RTX | ResNet34 | test image | 60 (capped) | Model returns accurate results, but framerates are less stable than Chrome |
| Windows 10 | Firefox | Titan RTX | ResNet34 | webcam | 34 | Model returns accurate results, but framerates are less stable than Chrome |
| Android 12 | Chrome | Snapdragon 865 | ResNet34 | test image | 7 | Model does not return accurate results |
| Android 12 | Firefox | Snapdragon 865 | ResNet34 | test image | 7 | Model returns accurate results |
| iPadOS | Safari | M1 | ResNet34 | test image | 16 | Model returns accurate results |
| macOS | Chrome | M1 Max | ResNet34 | test image | 35 (reported) | Model returns accurate results |
| macOS | Chrome | M1 Max | ResNet34 | webcam | 27 (reported) | Model returns accurate results |
## Tutorial Links
[GitHub Repository](https://github.com/cj-mills/fastai-to-unity-tutorial)
[Part 1](https://christianjmills.com/posts/fastai-to-unity-tutorial/part-1/): Part 1 covers training and exporting a model.
[Part 2](https://christianjmills.com/posts/fastai-to-unity-tutorial/part-2/): Part 2 covers implementing a trained model in a Unity project.
[Part 3](https://christianjmills.com/posts/fastai-to-unity-tutorial/part-3/): Part 3 covers building a Unity project to run in a web browser and hosting it using GitHub Pages.