Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/mgyong/awesome-mediapipe

A curated list of awesome MediaPipe related code examples, libraries and software
https://github.com/mgyong/awesome-mediapipe

List: awesome-mediapipe

Last synced: about 1 month ago
JSON representation

A curated list of awesome MediaPipe related code examples, libraries and software

Host: GitHub
URL: https://github.com/mgyong/awesome-mediapipe
Owner: mgyong
License: mit
Created: 2020-04-26T06:22:31.000Z (over 4 years ago)
Default Branch: master
Last Pushed: 2024-04-17T07:03:36.000Z (8 months ago)
Last Synced: 2024-05-20T03:21:45.687Z (7 months ago)
Size: 104 KB
Stars: 614
Watchers: 39
Forks: 66
Open Issues: 9
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

ultimate-awesome - awesome-mediapipe - A curated list of awesome MediaPipe related code examples, libraries and software. (Other Lists / Monkey C Lists)

README

        # Awesome MediaPipe

[![Build Status](https://travis-ci.org/mgyong/awesome-mediapipe.svg?branch=master)](https://travis-ci.org/mgyong/awesome-mediapipe) [![Awesome](https://cdn.rawgit.com/sindresorhus/awesome/d7305f38d29fed78fa85652e3a63e154dd8e8829/media/badge.svg)](https://github.com/sindresorhus/awesome) [![Slack Widget](https://img.shields.io/badge/join-us%20on%20slack-gray.svg?longCache=true&logo=slack&colorB=red)](https://mediapipe.page.link/joinslack)

A curated list of awesome MediaPipe related frameworks, libraries and software. Inspired by [awesome-go](https://github.com/avelino/awesome-go).

### Contributing

Please take a quick gander at the [contribution guidelines](https://github.com/mgyong/awesome-mediapipe/blob/master/CONTRIBUTING.md) first. Thanks to all [contributors](https://github.com/mgyong/awesome-mediapipe/graphs/contributors); you rock!

#### *If you see a package or project here that is no longer maintained or is not a good fit, please submit a pull request to improve this file. Thank you!*

### Contents

- [Awesome MediaPipe](#awesome-mp)

    - [Desktop examples](#desktop-examples)

    - [Android examples](#android-examples)

    - [iOS examples](#ios)

    - [Myriad X Vision Proocessing Unit](#myriad-x-vpu)

    - [Unity examples](#unity)

    - [Cloud examples](#cloud-examples)

    - [TensorFlow and TFlite related](#tensorflow-and-tfllite-related)

    - [Python related](#python-related)

    - [Pytorch related](#pytorch-related)

    - [Sign language hand gesture related](#sign-language-hand-gesture-related)

    - [Nvidia Jetson integration](#nvidia-jetson-integration-draft-beta)

- [Resources](#resources)

    - [Conferences](#conferences)

    - [Meetups](#meetups)

    - [Websites](#websites)

        - [Tutorials](#tutorials)

## Desktop examples

*Desktop examples of using MediaPipe.*

* [How to readout detection proto for Object Detection example](https://github.com/mgyong/mediapipe-issue200)

* [How to create Bazel project using MediaPipe as external dependence](https://github.com/mgyong/mediapipe_addons)

* [Connecting openFrameworks to Google MediaPipe Machine Learning Framework over UDP](https://github.com/madelinegannon/example-mediapipe-udp)

* [Sign gesture recognition with Mediapipe](https://github.com/nodamu/sign-language-recogntion)

* [MediaPipe Python examples using WebRTC based OSSDC VisionAI platform](https://github.com/OSSDC/OSSDC-VisionAI-Core/blob/master/video_processing_mediapipe.py)

## Android examples

*Android examples.*

* [MediaPipe face detection gpu demo with MediaPipe's Android archive library](https://github.com/jiuqiant/mediapipe_face_detection_aar_example)

* [MediaPipe multi-hand tracking gpu demo with MediaPipe's Android archive library](https://github.com/jiuqiant/mediapipe_multi_hands_tracking_aar_example)

* [MediaPipe hair segmentation example in gradle](https://github.com/afsaredrisy/MediapipeSegmentationGradle)

* [Kotlin port of running MediaPipe hand tracking example](https://github.com/machidyo/MediaPipeHandTracking)

## iOS

*iOS examples.*

* [Tutorial to create an importable iOS framework: Find memes that match your facial expression 😮](https://medium.com/@powderapp/mediapipe-tutorial-find-memes-that-match-your-facial-expression-9bf598da98c0)

* [How to build MediaPipe hand tracking (iOS) as an Xcode project](https://qiita.com/ponte1010/items/ed10cb2b5dcf7579f9bc)

## Myriad X VPU

*DepthAI cameras examples.*

* [Hand tracking with DepthAI](https://github.com/geaxgx/depthai_hand_tracker)

* [MediaPipe hands tracking on DepthAI camera through OSSDC VisionAI on WebRTC video stream from Android phone](https://www.youtube.com/watch?v=CdvpjKfNUWw)

## Unity

* [Unity hand tracking with MediaPipe](https://github.com/TesseraktZero/UnityHandTrackingWithMediapipe)

* [Unity MediaPipe Plugin](https://github.com/homuler/MediapipeUnityPlugin)

### frameworks

*iOS frameworks.*

* [Prebuilt framework for upper body pose tracking](https://github.com/noppefoxwolf/UpperBodyPoseTracker)

* [Prebuilt framework for hand tracking](https://github.com/noppefoxwolf/HandTracker)

## Cloud examples

*Cloud examples.*

* [How to install MediaPipe on GPU instance in Amazon EC2.](https://dev.classmethod.jp/articles/mediapipe-install-on-aws-ec2-with-gpu-english/)

* [MediaPipe Holistic running in Google Colab on WebRTC video stream from Android phone](https://www.youtube.com/watch?v=0l9Bb5IC86E)

    - [Google Colab to reproduce this demo in less than 5 min](https://colab.research.google.com/github/OSSDC/OSSDC-VisionAI-Core/blob/master/OSSDC_VisionAI_demo_reel.ipynb)

## TensorFlow and TFllite related

*TensorFlow and TFLite examples.*

* [Face tracking web utility with applied filters for headtracking spatial audio uses](https://github.com/Mach1Studios/m1-web-spatialaudioplayer)

* [Sample code for sharing and testing TFLite models quantized and optimized for ARM devices (e.g. RaspberryPi) with BlazeFace, FaceMesh, BodyPix, and Objectron](https://github.com/PINTO0309/PINTO_model_zoo)

## Python related

* [simple-mediapipe](https://github.com/mengfu188/simple-mediapipe) python reimplement

* [MediaPipe Holistic running in Google Colab on WebRTC video stream from Android phone](https://www.youtube.com/watch?v=0l9Bb5IC86E)

    - [Google Colab to reproduce this demo in less than 5 min](https://colab.research.google.com/github/OSSDC/OSSDC-VisionAI-Core/blob/master/OSSDC_VisionAI_demo_reel.ipynb)

* [MediaPipe Python Wheel installer (pip) for RaspberryPi OS aarch64, Ubuntu aarch64 Debian aarch64, L4T/Jetson Nano aarch64.](https://github.com/PINTO0309/mediapipe-bin)

* [Recognizes hand signs and finger gestures using Python mediapipe](https://github.com/Kazuhito00/hand-gesture-recognition-using-mediapipe)

## Flutter related

* [Flutter package for MediaPipe Hand tracking example to generate both iOS and Android apps](https://github.com/zhouzaihang/flutter_hand_tracking_plugin)

## Pytorch related

*Pytorch examples.*

## Sign language hand gesture related

* [Sign Language Gesture Recognition Android](https://github.com/nodamu/sign-language-recogntion-android)

* [Sign language gesture recognition using a recurrent neural network (RNN) with Mediapipe hand tracking](https://github.com/rabBit64/Sign-language-recognition-with-RNN-and-Mediapipe)

* [SigNN - American sign language alphabet translation](https://github.com/AriAlavi/SigNN)

* [System for recognizing signs of the german sign language (DGS) from live webcam](https://github.com/Tachionstrahl/SignLanguageRecognition)

* [Hand commander: MQTT implementation of custom hand gestures running on raspberry pi](https://www.deuxexsilicon.com/2020/03/16/1st-motivation-and-first-steps/)

## Nvidia Jetson integration, draft [beta]

*  [Step by step tutorial on MediaPipe on Nvidia Jetson](https://github.com/AndreV84/mediapipe)

# Resources

*Where to discover new MediaPipe libraries.*

## Meetups

*Add the group of your city/country here (send **PR**)*

## Websites

* [3D Web Hands with MediaPipe + tf.js](https://glitch.com/edit/#!/3dweb-hands?path=README.md%3A1%3A0)

* [Handsfree.js.org](https://handsfree.js.org) - A wrapper library around MediaPipe with a plugin system for quickly creating and sharing handsfree user experiences. Features detailed guides and documentation, integrations and boilerplates, chrome extensions, and more

### Tutorials

* [Creating Calculators, Beyond the Documentation](https://codeburst.io/creating-calculators-in-mediapipe-beyond-the-documentation-83e1883b91a?source=friends_link&sk=0428794f27a1e7d62cdd0726fdc5eb62) - Read this after reading the documentation by students at UC Satna Barbara

* [MediaPipe with Custom tflite Model](https://blog.gofynd.com/mediapipe-with-custom-tflite-model-d3ea0427b3c1?gi=34cdb896bc94) - Getting started tutorial by engineers at Indian startup Fynd