https://github.com/seanschneeweiss/rosemotion
Hand Motion Capture from a 3D Leap Motion Controller for a Musculoskeletal Dynamic Simulation implemented in Python
https://github.com/seanschneeweiss/rosemotion
anybody anypytools bvh c3d hand-tracking joint-angles leap-motion leapmotion mocap motion-capture python ulm-university
Last synced: about 1 year ago
JSON representation
Hand Motion Capture from a 3D Leap Motion Controller for a Musculoskeletal Dynamic Simulation implemented in Python
- Host: GitHub
- URL: https://github.com/seanschneeweiss/rosemotion
- Owner: seanschneeweiss
- License: mit
- Created: 2020-12-08T20:03:20.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2024-03-18T21:55:48.000Z (about 2 years ago)
- Last Synced: 2025-03-24T00:51:30.579Z (about 1 year ago)
- Topics: anybody, anypytools, bvh, c3d, hand-tracking, joint-angles, leap-motion, leapmotion, mocap, motion-capture, python, ulm-university
- Language: Python
- Homepage:
- Size: 34.6 MB
- Stars: 23
- Watchers: 2
- Forks: 8
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[](http://unmaintained.tech/)
# ROSE Motion
Zenodo Code Archive: [](https://doi.org/10.5281/zenodo.4344201) MDPI Sensors Article: [](https://doi.org/10.3390/s21041199)
LeapMotion recording, export to BVH and Anybody
## Structure / Actions
* **Record**
Plug in the Leap Motion Controller and make a recording of the right hand
* **Settings**
* Setting "Frames per second" defines the minimum time delta between to recorded frames
* Checking "Animate" will open the bvh animation after recording, a slider can be used to iterate through the frames
* Setting the basis
* **BVH Export**
* Setting "Write BVH-File" will export the recorded motion to a BVH file defined in the next setting
* Choose the filepath and name in "BVH File"
* Setting "BVH Channels" will export either the channels XRotation, YRotation, ZRotation or also XPosition, YPosition, ZPosition
* **Interpolation Vector**
* Setting "Write interpolation files for AnyBody" will export the files
* Elbow.any (pronation angle)
* Finger[1-5].any (angles for all finger joints)
* FingerLength.any (scaling of the finger lengths based on Leap Motion recording)
* TimeSeries.any (equally spaced time points between 0 and 1)
* Wrist.any (abduction and flexion angles for wrist)
* Choose the template directory, the AnyBody interpolation files are written based on those files
* Choose the output directory, here the above mentioned files will be saved to
* **AnyBody** ([repository](https://github.com/seanschneeweiss/RoSeMotion-AnyBody))
* **Source files**
* Choose "exisiting vector files" if interpolation files are already in the project folder /Model/InterpolVec
* Choose ".bvh file" to convert it to the interpolation files based on the templates in config/anybody_templates/ and copy into the AnyBody project folder /Model/InterpolVec
* Choose "Source (.any)" to copy all .any files into the AnyBody project folder /Model/InterpolVec
* Setting "HAND.Main.any" defines the main model file of the AnyBody project, which should be loaded for the analysis
* Setting "Start Frame" will define the first frame to start with (cut off the frames before that). Leaving this option empty will set the first frame to 1
* Setting "End Frame" will define the last frame to end with (cut off the frames after that). Leaving this option empty will set the last frame to end
* **Operations**
* Select the operations which should be executed in AnyBody
* Setting "Time steps" will rewrite alls lines which match ``nStep = xx;`` in the main model file. (e.g. ``nStep = 50;``)
* **Results**
* Selecting "plot after the analysis" will open an interactive plot for the results from the AnyBody analysis (joint angles)
* Setting ".anydata.h5 file" will save the results from the AnyBody anaylsis to the specified file
* Selecting "Open AnyBody" will open the AnyBody GUI after the analysis and will load the .anydata.h5 to make a replay available
* **Converter**
* Convert a given bvh file to the interpolation files used for AnyBody based on the templates in config/anybody_templates
* **Animation**
* Open a bvh file to animate it, a slider can be used to iterate through the frames
### Basis setting
* AnyBody initial basis -> select for correct movement within AnyBody
* Leap Motion first frame basis -> select for exporting to BVH and use in other applications
## Setup
**Windows**
* Install python (3.9.13) i.e. from
https://www.python.org/downloads/
* Add python to system path during setup or follow the following instructions:
https://github.com/BurntSushi/nfldb/wiki/Python-&-pip-Windows-installation
* Install dependencies, by running the following in a command prompt:
```
pip install -r requirements.txt
```
You might have to use `pip3` instead, depending on your setup.
* Start RoSeMotion
```
python app/main.py
```
---
Following python packages and versions were tested:
* _Gooey_ (1.0.8.1)
* _AnyPyTools_ (1.7.8)
* _Matplotlib_ (3.3.3) (only for AnyBody results)
* _Numpy_ (1.19.5)
* _Pandas_ (1.1.5)
* _pywin32_ (301) (only for window size automation)
* _pywinauto_ (0.6.8) (only for window size automation)
* _Scikit-learn_ (0.23.2) (only for BVH animation)
* _wxPython_ ([4.1.2a1.dev5330+3e6be81d](https://wxpython.org/Phoenix/snapshot-builds/wxPython-4.1.2a1.dev5330+3e6be81d-cp39-cp39-win_amd64.whl))
## Credits
* https://github.com/chriskiehl/Gooey
* https://github.com/YPZhou/b3d/
* https://github.com/AnyBody-Research-Group/AnyPyTools
* https://github.com/leapmotion/LeapCxx
* https://github.com/omimo/PyMO