https://github.com/axel7083/facecommands
Program to autoscroll using face gestures (blinking)
https://github.com/axel7083/facecommands
accessibility android application eyes gestures scrolling tiktok
Last synced: about 2 months ago
JSON representation
Program to autoscroll using face gestures (blinking)
- Host: GitHub
- URL: https://github.com/axel7083/facecommands
- Owner: axel7083
- License: gpl-3.0
- Created: 2021-03-23T15:09:33.000Z (about 5 years ago)
- Default Branch: main
- Last Pushed: 2021-04-19T16:19:58.000Z (about 5 years ago)
- Last Synced: 2025-09-21T09:35:46.790Z (9 months ago)
- Topics: accessibility, android, application, eyes, gestures, scrolling, tiktok
- Language: Java
- Homepage:
- Size: 350 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# FaceCommands
I made a [Medium article](https://axel7083.medium.com/using-googles-ml-kit-to-control-an-android-device-without-hands-cf2a1c589e73) about this project.
This application can displays gestures such as scrolling according to facial expression. In particular it allows to detect single eye blinking. By default, blinking with the left eye will scroll down, and blinking with the right eyes will scroll up.
This application was design to use Tiktok without hands. Allowing to scroll without touching your screen.
# Under the hood
The application is using the [Mobile Vision API](https://developers.google.com/vision/android/getting-started) to detect facial expression, an [Accessibility service](https://developer.android.com/reference/android/accessibilityservice/AccessibilityService) to display the gestures and the camera to get the image input.
TODO:
- [ ] Smiling interaction