https://github.com/sadmanyasar/tensorflow-pose-detection-react-native-expo
A modified version of TFJS Pose Detection model (MoveNet.SinglePose.Ligntning) using TFJS React Native in an Expo project.
https://github.com/sadmanyasar/tensorflow-pose-detection-react-native-expo
expo react-native tensorflow typescript
Last synced: 6 months ago
JSON representation
A modified version of TFJS Pose Detection model (MoveNet.SinglePose.Ligntning) using TFJS React Native in an Expo project.
- Host: GitHub
- URL: https://github.com/sadmanyasar/tensorflow-pose-detection-react-native-expo
- Owner: SadmanYasar
- Created: 2023-09-05T09:11:34.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2023-09-24T01:06:15.000Z (about 2 years ago)
- Last Synced: 2024-04-16T17:38:08.862Z (over 1 year ago)
- Topics: expo, react-native, tensorflow, typescript
- Language: TypeScript
- Homepage:
- Size: 4.77 MB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Overview
A modified version of [TFJS Pose Detection][posedetection] model
([MoveNet.SinglePose.Ligntning][tfhub]) using
[TFJS React Native][tfjs-react-native] in an Expo project. It supports both
portrait and landscape mode with front and back camera. Only the keypoints are
rendered in the demo.
# Note
This project uses Expo SDK 49 and jsc instead of Hermes. FPS is very low on my phone, around 3-4 FPS.
I updated Camera.Constants.Type to CameraType.front/back.
Added 3 additional props to TensorCamera according to [this](https://js.tensorflow.org/api_react_native/0.2.1/#Media-Camera) documentation.
Also updated tsconfig.json to use settings for Expo SDK 49.
Update 9/23/2023: Stopping development on this project for now. Will experiment with Flutter and Firebase MLkit.
# Installation
To run it locally:
```
$ yarn
$ yarn start
```
Then scan the QR code to open it in the `Expo Go` app.
If the app crashes on startup, see [here][readme] for more info.
[posedetection]: https://github.com/tensorflow/tfjs-models/tree/master/pose-detection
[tfhub]: https://tfhub.dev/google/tfjs-model/movenet/singlepose/lightning/4
[tfjs-react-native]: https://github.com/tensorflow/tfjs/tree/master/tfjs-react-native
[screenshots]: https://photos.app.goo.gl/U972ww4HpaKPK6jEA
[readme]: https://github.com/tensorflow/tfjs-examples/blob/master/react-native/README.md