{"id":22352257,"url":"https://github.com/audiofhrozen/motion_dance","last_synced_at":"2025-07-25T23:11:54.863Z","repository":{"id":55043439,"uuid":"157529847","full_name":"audiofhrozen/motion_dance","owner":"audiofhrozen","description":"Sequential Learning for Dance generation","archived":false,"fork":false,"pushed_at":"2021-01-13T11:50:40.000Z","size":68967,"stargazers_count":20,"open_issues_count":3,"forks_count":4,"subscribers_count":3,"default_branch":"master","last_synced_at":"2023-06-02T13:34:01.569Z","etag":null,"topics":["chainer","dance-generation","deep-learning","motion-dance","sequential-learning"],"latest_commit_sha":null,"homepage":"https://audiofhrozen.github.io/motion_dance/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/audiofhrozen.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-11-14T10:13:02.000Z","updated_at":"2021-12-18T07:41:05.000Z","dependencies_parsed_at":"2022-08-14T10:00:31.009Z","dependency_job_id":null,"html_url":"https://github.com/audiofhrozen/motion_dance","commit_stats":null,"previous_names":[],"tags_count":null,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/audiofhrozen%2Fmotion_dance","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/audiofhrozen%2Fmotion_dance/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/audiofhrozen%2Fmotion_dance/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/audiofhrozen%2Fmotion_dance/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/audiofhrozen","download_url":"https://codeload.github.com/audiofhrozen/motion_dance/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":228106307,"owners_count":17870438,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["chainer","dance-generation","deep-learning","motion-dance","sequential-learning"],"created_at":"2024-12-04T12:17:56.170Z","updated_at":"2024-12-04T12:17:56.786Z","avatar_url":"https://github.com/audiofhrozen.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Sequential Learning for Dance generation\n\n[![Build Status](https://travis-ci.com/Fhrozen/motion_dance.svg?branch=master)](https://travis-ci.com/Fhrozen/motion_dance)\n\nGenerating dance using deep learning techniques.\n\nThe proposed model is shown in the following image:\n\n![Proposed Model](images/seq2seq_mc.png?raw=true \"Title\")\n\nThe joints of the skeleton employed in the experiment are shown in the following image:\n\n![Skeleton](images/skeleton.png?raw=true \"Title\")\n\n### Use of GPU\nIf you use GPU in your experiment, set `--gpu` option in `run.sh` appropriately, e.g., \n```sh\n$ ./run.sh --gpu 0\n```\nDefault setup uses GPU 0 (`--gpu 0`). For CPU execution set gpu to -1\n\n## Execution\nThe main routine is executed by:\n```sh\n$ ./run.sh --net $net --exp $exp --sequence $sequence --epoch $epochs --stage $stage\n```\nBeing possible to train different type of datasets (`$exp`)\n\nTo run into a docker container use the file (`run_in_docker.sh`) instead of (`run.sh`)\n\n## Unreal Engine 4 Visualization\n\nFor demostration from evaluation files or for testing training files use (`local/ue4_send_osc.py`).\nFor realtime emulation execute (`run_realtime.sh`). \n\n\n## Requirements\n\nFor training and evaluating the following python libraries are required:\n- [chainer=\u003e3.1.0](https://github.com/chainer/chainer) \n- [chainerui](https://github.com/chainer/chainerui)\n- [cupy=\u003e2.1.0](https://github.com/cupy/cupy)\n- [madmom](https://github.com/CPJKU/madmom/)\n- [Beat Tracking Evaluation toolbox](https://github.com/Fhrozen/Beat-Tracking-Evaluation-Toolbox). The original code is found [here](https://github.com/adamstark/Beat-Tracking-Evaluation-Toolbox)\n- [mir_eval](https://github.com/craffel/mir_eval)\n- [transforms3d](https://github.com/matthew-brett/transforms3d)\n- h5py, numpy, soundfile, scipy, scikit-learn, pandas\n\nInstall the following music libraries to convert the audio files:\n```sh\n$ sudo apt-get install libsox-fmt-mp3\n```\n\nAdditionally, you may require [Marsyas](http://marsyas.info/doc/manual/marsyas-user/Building-latest-Marsyas-on-Debian_002fUbuntu.html#Building-latest-Marsyas-on-Debian_002fUbuntu) to extract the bet reference information.  \n\nFor real-time emulation:\n- pyOSC (for python v2)\n- python-osc (for python v3)\n- vlc (optional)\n\n## ToDo:\n- New dataset\n- Detailed audio information\n- Virtual environment release\n\n## Acknowledgement\n- Thanks Johnson Lai for the comments\t\n\n## References\n\n[1] Nelson Yalta, Shinji Watanabe, Kazuhiro Nakadai, Tetsuya Ogata, \"Weakly Supervised Deep Recurrent Neural Networks for Basic Dance Step Generation\", [arXiv](https://arxiv.org/abs/1807.01126)\n\n[2] Nelson Yalta, Kazuhiro Nakadai, Tetsuya Ogata, \"Sequential Deep Learning for Dancing Motion Generation\", [SIG-Challenge 2016](http://www.osaka-kyoiku.ac.jp/~challeng/SIG-Challenge-046/SIG-Challenge-046-08.pdf)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faudiofhrozen%2Fmotion_dance","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faudiofhrozen%2Fmotion_dance","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faudiofhrozen%2Fmotion_dance/lists"}