https://github.com/cj-mills/tfjs-yolox-unity-tutorial

Create a TensorFlow.js plugin for the Unity game engine to perform object detection with a YOLOX model.
https://github.com/cj-mills/tfjs-yolox-unity-tutorial

object-detection tfjs tutorial unity3d webgl yolox

Last synced: 3 months ago
JSON representation

Create a TensorFlow.js plugin for the Unity game engine to perform object detection with a YOLOX model.

• Host: GitHub
• URL: https://github.com/cj-mills/tfjs-yolox-unity-tutorial
• Owner: cj-mills
• License: mit
• Created: 2022-09-13T22:56:13.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-10-17T02:25:47.000Z (over 2 years ago)
• Last Synced: 2024-11-13T05:35:14.039Z (5 months ago)
• Topics: object-detection, tfjs, tutorial, unity3d, webgl, yolox
• Language: Jupyter Notebook
• Homepage: https://christianjmills.com/posts/tfjs-yolox-unity-tutorial/
• Size: 172 MB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# TensorFlow.js+YOLOX → Unity Tutorial

## Tutorial Links

- [In-Browser Object Detection for Unity with TensorFlow.js](https://christianjmills.com/posts/tfjs-yolox-unity-tutorial/): Create a TensorFlow.js plugin for the Unity game engine to perform object detection with a YOLOX model. 

## In-Browser Demo

| GitHub Repository    | Demo Link      |

| --------------------------------- | ------------------------------------------------------------ |

| [hand-gesture-detector-webgl-demo](https://github.com/cj-mills/hand-gesture-detector-webgl-demo) | [Hand Gesture Detector](https://cj-mills.github.io/hand-gesture-detector-webgl-demo/) |

## Model Conversion Code

| Jupyter Notebook             | Colab                                                        | Kaggle                                                       |

| --------------------------------- | ------------------------------------------------------------ | ------------------------------------------------------------ |

| [GitHub Repository](https://github.com/cj-mills/tfjs-yolox-unity-tutorial/blob/main/notebooks/ONNX-to-TF-to-TFJS.ipynb) | [Open In Colab](https://colab.research.google.com/github/cj-mills/tfjs-yolox-unity-tutorial/blob/main/notebooks/ONNX-to-TF-to-TFJS-Colab.ipynb) | [Open in Kaggle](https://kaggle.com/kernels/welcome?src=https://github.com/cj-mills/tfjs-yolox-unity-tutorial/blob/main/notebooks/ONNX-to-TF-to-TFJS-Kaggle.ipynb) |

Reference Images



| Class    | Image                                              |

| --------- | ------------------------------------------------------------ |

| call    | ![call](./images/call.jpg) |

| dislike         | ![dislike](./images/dislike.jpg) |

| fist    | ![ fist](./images/fist.jpg) |

| four         | ![four](./images/four.jpg) |

| like         | ![ like](./images/like.jpg) |

| mute         | ![ mute](./images/mute.jpg) |

| ok    | ![ ok](./images/ok.jpg) |

| one         | ![ one](./images/one.jpg) |

| palm         | ![ palm](./images/palm.jpg) |

| peace         | ![peace](./images/peace.jpg) |

| peace_inverted         | ![peace_inverted](./images/peace_inverted.jpg) |

| rock         | ![rock](./images/rock.jpg) |

| stop         | ![stop](./images/stop.jpg) |

| stop_inverted         | ![stop_inverted](./images/stop_inverted.jpg) |

| three         | ![three](./images/three.jpg) |

| three2         | ![three2](./images/three2.jpg) |

| two_up         | ![ two_up](./images/two_up.jpg) |

| two_up_inverted         | ![two_up_inverted](./images/two_up_inverted.jpg) |