https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin

OpenPose's Unity Plugin for Unity users
https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin

c-sharp deep-learning human-pose-estimation openpose real-time unity

Last synced: about 1 month ago
JSON representation

OpenPose's Unity Plugin for Unity users

• Host: GitHub
• URL: https://github.com/CMU-Perceptual-Computing-Lab/openpose_unity_plugin
• Owner: CMU-Perceptual-Computing-Lab
• License: other
• Created: 2018-12-18T00:09:01.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2019-08-14T04:41:27.000Z (over 5 years ago)
• Last Synced: 2024-08-03T23:22:55.798Z (5 months ago)
• Topics: c-sharp, deep-learning, human-pose-estimation, openpose, real-time, unity
• Language: C#
• Homepage: https://github.com/CMU-Perceptual-Computing-Lab/openpose
• Size: 6.08 MB
• Stars: 707
• Watchers: 46
• Forks: 166
• Open Issues: 46
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-list - OpenPose Unity Plugin - A wrapper of the OpenPose library for Unity users. (Computer Vision / Classification & Detection & Tracking)

README

        


    



-----------------

**OpenPose Unity Plugin** is a **wrapper of the [OpenPose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) library for Unity users**. It provides formatted OpenPose output and some examples. [OpenPose](https://github.com/CMU-Perceptual-Computing-Lab/openpose) is a real-time multi-person system able to jointly detect human body, hand, facial, and foot keypoints (in total 135 keypoints) on single images.

The OpenPose Unity Plugin project is **authored by [Tianyi Zhao](http://tianyizhao.com), [Gines Hidalgo](https://www.gineshidalgo.com/), and [Yaser Sheikh](http://www.cs.cmu.edu/~yaser/)**. Currently, it is being **maintained by [Tianyi Zhao](http://tianyizhao.com) and [Gines Hidalgo](https://www.gineshidalgo.com/)**.

[**Demo/tutorial video**](https://youtu.be/Jrcak4n6PG4) of the working system.



    

    


    Tianyi Zhao (left) and Gines Hidalgo (right) testing the OpenPose Unity Plugin



## NOTICE

This is an alpha release, everything is subject to change. The plugin will finally be available in Unity Assets store in the future.

## Contents

1. [Results](#results)

2. [Installation, Reinstallation and Uninstallation](#installation-reinstallation-and-uninstallation)

3. [Citation](#citation)

4. [License](#license)

## Results

### Body and Foot Estimation



    

    


    Testing the OpenPose Unity Plugin for body and foot detection



### Body, Foot, Face, and Hands Estimation



    

    


    Testing the OpenPose Unity Plugin for body, foot, face, and hand detection



## Installation, Reinstallation and Uninstallation

Follow the steps in the installation documentation in [doc/installation.md](doc/installation.md).

## Citation

Please cite these papers in your publications if it helps your research (the face keypoint detector was trained using the procedure described in [Simon et al. 2017] for hands):

    @inproceedings{cao2018openpose,

      author = {Zhe Cao and Gines Hidalgo and Tomas Simon and Shih-En Wei and Yaser Sheikh},

      booktitle = {arXiv preprint arXiv:1812.08008},

      title = {Open{P}ose: realtime multi-person 2{D} pose estimation using {P}art {A}ffinity {F}ields},

      year = {2018}

    }

    @inproceedings{cao2017realtime,

      author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},

      booktitle = {CVPR},

      title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},

      year = {2017}

    }

    @inproceedings{simon2017hand,

      author = {Tomas Simon and Hanbyul Joo and Iain Matthews and Yaser Sheikh},

      booktitle = {CVPR},

      title = {Hand Keypoint Detection in Single Images using Multiview Bootstrapping},

      year = {2017}

    }

    @inproceedings{wei2016cpm,

      author = {Shih-En Wei and Varun Ramakrishna and Takeo Kanade and Yaser Sheikh},

      booktitle = {CVPR},

      title = {Convolutional pose machines},

      year = {2016}

    }

Links to the papers:

- [OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://arxiv.org/abs/1812.08008)

- [Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields](https://arxiv.org/abs/1611.08050)

- [Hand Keypoint Detection in Single Images using Multiview Bootstrapping](https://arxiv.org/abs/1704.07809)

- [Convolutional Pose Machines](https://arxiv.org/abs/1602.00134)

## License

OpenPose Unity Plugin is freely available for free non-commercial use, and may be redistributed under these conditions. Please, see the [license](LICENSE) for further details. Interested in a commercial license? Check this [FlintBox link](https://flintbox.com/public/project/47343/). For commercial queries, use the `Directly Contact Organization` section from the [FlintBox link](https://flintbox.com/public/project/47343/) and also send a copy of that message to [Yaser Sheikh](http://www.cs.cmu.edu/~yaser/).