{"id":17466381,"url":"https://github.com/mauricioromagnollo/gesture-video-controller","last_synced_at":"2026-05-03T22:32:00.002Z","repository":{"id":90113994,"uuid":"607383339","full_name":"mauricioromagnollo/gesture-video-controller","owner":"mauricioromagnollo","description":"Controlling Streaming Platforms using Eye and Hand Detection.","archived":false,"fork":false,"pushed_at":"2023-03-03T02:26:35.000Z","size":60081,"stargazers_count":1,"open_issues_count":2,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-10-08T08:52:46.374Z","etag":null,"topics":["canvas","eye-detection","hand-detection","javascript","machine-learning","mediapipe","mediapipe-face-detection","mediapipe-hands","multithreading","tensorflow","tensorflowjs","webcam","webworkers"],"latest_commit_sha":null,"homepage":"https://mauricioromagnollo.github.io/gesture-video-controller/","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mauricioromagnollo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-02-27T21:42:58.000Z","updated_at":"2023-08-04T10:05:21.000Z","dependencies_parsed_at":null,"dependency_job_id":"7b1d3b38-8537-4fd1-be00-b7f2fbc36607","html_url":"https://github.com/mauricioromagnollo/gesture-video-controller","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/mauricioromagnollo/gesture-video-controller","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mauricioromagnollo%2Fgesture-video-controller","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mauricioromagnollo%2Fgesture-video-controller/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mauricioromagnollo%2Fgesture-video-controller/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mauricioromagnollo%2Fgesture-video-controller/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mauricioromagnollo","download_url":"https://codeload.github.com/mauricioromagnollo/gesture-video-controller/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mauricioromagnollo%2Fgesture-video-controller/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32587816,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-03T22:12:39.696Z","status":"ssl_error","status_checked_at":"2026-05-03T22:09:10.534Z","response_time":103,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["canvas","eye-detection","hand-detection","javascript","machine-learning","mediapipe","mediapipe-face-detection","mediapipe-hands","multithreading","tensorflow","tensorflowjs","webcam","webworkers"],"created_at":"2024-10-18T13:25:11.175Z","updated_at":"2026-05-03T22:31:59.982Z","avatar_url":"https://github.com/mauricioromagnollo.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# gesture-video-controller\n\n## 🖥️ **Preview**\n\n\u003cimg width=100% src=\"./.github/images/preview.gif\"\u003e\n\n## 🛞 **Dependencies**\n\n- Node.js v19.6.1;\n- It's recommended to use Unix environments (Linux). If you are using Windows, it's recommended to use [Windows Subsystem Linux](https://www.omgubuntu.co.uk/how-to-install-wsl2-on-windows-10);\n- It's recommended to use Google Chrome Browser;\n\n## 🚀 **Running**\n\nInstall Node.js 19.6.1 and restore the dependencies:\n\n```bash\nnpm ci\n```\n\nStart the project:\n\n```bash\nnpm start\n```\n\nOpen your browser at [http://localhost:3000](http://localhost:3000).\n\n## ✅ **Features Checklist**\n\n- **Titles List**\n  - [X] Should not crash the search field when typing a search term;\n  - [X] Should draw hands on screen and make background elements still clickable 🙌;\n  - [X] Should trigger scroll up when using open palm 🖐;\n  - [X] Should trigger scroll down when using closed palm ✊;\n  - [X] Should trigger click on nearest element when using pinch gesture 🤏🏻;\n  - [X] Should trigger **:hover** event on elements in context, when moving elements on screen;\n- **Video Player**\n  - [X] Should be possible to play or pause videos with the blink of an eye 😉;\n  - [X] All machine learning processing must be done through a web worker;\n\n\n## 🌟 **Credits**\n\n- This project was created in \"[Semana JS Expert 7.0](https://semana.javascriptexpert.com.br/)\" (JS Expert Week 7.0). Event developed by [Erick Wendel](https://github.com/erickwendel).\n- Classes project: https://github.com/ErickWendel/semana-javascript-expert07\n- The interface was based on project [Streaming Service](https://codepen.io/Gunnarhawk/pen/vYJEwoM) by [gunnarhawk](https://github.com/Gunnarhawk)\n\n## 📚 **References**\n\n- [Google Machine Learning for Web Developers](https://youtube.com/playlist?list=PLOU2XLYxmsILr3HQpqjLAUkIPa5EaZiui)\n- [Training Machine Learning at Google](https://teachablemachine.withgoogle.com/)\n- [TensorFlow Projects](https://youtube.com/playlist?list=PLQY2H8rRoyvzSZZuF0qJpoJxZR1NgzcZw)\n- [Database Used](https://www.kaggle.com/code/vikassingh1996/netflix-movies-and-shows-plotly-recommender-sys/data)\n- [Convert Video to Canvas](https://stackoverflow.com/questions/64249599/how-to-run-handpose-tfjs-model-in-web-worker)\n- [Tensorflow Blog](https://blog.tensorflow.org/2020/11/iris-landmark-tracking-in-browser-with-MediaPipe-and-TensorFlowJS.html)\n- [Tensorflow Lib: face-landmarks-detection](https://github.com/tensorflow/tfjs-models/blob/master/face-landmarks-detection)\n- [Workers Api](https://developer.mozilla.org/en-US/docs/Web/API/Web_Workers_API/Using_web_workers)\n- [Blink Detection Example](https://selvamsubbiah.com/mediapipe-iris-detection-in-tensorflow-js/)\n- [Morse Code With Eye Detection](https://medium.com/the-web-tub/recognising-eye-blinking-with-tensorflow-js-3c02b738850d)\n- [Why webgl, cpu, webassembly](https://youtu.be/3ive-w7oUis?t=333)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmauricioromagnollo%2Fgesture-video-controller","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmauricioromagnollo%2Fgesture-video-controller","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmauricioromagnollo%2Fgesture-video-controller/lists"}