https://github.com/sphamba/trainguide
Mobile ML model to detect door buttons on Swiss trains
https://github.com/sphamba/trainguide
Last synced: 11 days ago
JSON representation
Mobile ML model to detect door buttons on Swiss trains
- Host: GitHub
- URL: https://github.com/sphamba/trainguide
- Owner: sphamba
- Created: 2020-11-29T10:40:34.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2020-11-29T12:11:09.000Z (over 4 years ago)
- Last Synced: 2025-02-17T05:11:21.404Z (3 months ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 38.9 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# TrainGuide
An object detector model is used to find the handle/button of a train door and guidance for blind people is provided by sound cues.
## Model training
We opted for a MobileNet V2 of 320x320 for its relatively high speed, in order to reach real-time performances on mobile devices. The directory `model` contains Notebooks to train a model in Tensorflow from a pre-trained model found on the _TensorFlow 2 Detection Model Zoo_. A script is then used to convert the exported model for use with Tensorflow JS in a web browser.
## WebApp
The trained model is used on a real time video captured from the device camera to find the positions of doors (closed or opened), buttons and handles.
[...]