{"id":22428562,"url":"https://github.com/dakup/handposeshapevae","last_synced_at":"2025-03-27T06:44:19.026Z","repository":{"id":208510887,"uuid":"284481182","full_name":"DaKup/HandPoseShapeVAE","owner":"DaKup","description":"Experimental hub; various VAE implementations for unsupervised disentanglement of hand pose and shape latent space","archived":false,"fork":false,"pushed_at":"2020-08-09T16:54:15.000Z","size":74532,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-02-01T11:43:56.749Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DaKup.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2020-08-02T14:47:10.000Z","updated_at":"2024-09-07T09:21:56.000Z","dependencies_parsed_at":"2023-11-21T21:49:31.760Z","dependency_job_id":null,"html_url":"https://github.com/DaKup/HandPoseShapeVAE","commit_stats":null,"previous_names":["dakup/handposeshapevae"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DaKup%2FHandPoseShapeVAE","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DaKup%2FHandPoseShapeVAE/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DaKup%2FHandPoseShapeVAE/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DaKup%2FHandPoseShapeVAE/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DaKup","download_url":"https://codeload.github.com/DaKup/HandPoseShapeVAE/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245798538,"owners_count":20673901,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-05T20:15:17.535Z","updated_at":"2025-03-27T06:44:18.999Z","avatar_url":"https://github.com/DaKup.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# HandPoseShapeVAE\n\n(not actively maintained)\n\nExperimental framework for unsupervised hand pose and shape disentanglement\n\nThanks to\n- https://github.com/moberweger/deep-prior-pp\n- https://github.com/rtqichen/beta-tcvae\n- https://github.com/Knight13/beta-VAE-disentanglement\n- https://github.com/AntixK/PyTorch-VAE\n\n\n## Getting Started\n\nThese instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.\n\n### Prerequisites\n\nWhat things you need to install the software and how to install them\n\n- [PyTorch 1.1](https://pytorch.org/)\n- [CUDA 10](https://developer.nvidia.com/cuda-downloads)\n- [TensorboardX](https://github.com/lanpa/tensorboardX)\n- [2015 MSRA Hand Gesture Dataset](https://jimmysuen.github.io/)\n\n\n### Setup\n\n(In the following, the working directory should be the same location as this readme file)\n\nCreate the following directories:\n```txt\n../data/preprocessed\n../models\n```\n\nDownload/Save dataset as\n\n```txt\n../data/MSRA15/P0\n...\n../data/MSRA15/P8\n```\n\n## Preprocess\n\nImport sequences into rendered format\n\n```txt\npreprocess/import_msra.py --input-dataset \"../data/MSRA15\" --label-name \"msra\"\n```\n\nMerge rendered sequences\n\n```txt\npreprocess/merge_rendered.py\n```\n\nSplit dataset into train, validation and test datasets\n\n```txt\npreprocess/preprocess_rendered.py --input-dataset \"../data/msra_merged.npz\" --label-name \"msra_merged\" --random\n```\n\n## Train\n\n```txt\nmain.py --basename \"HandPoseShapeVAE_MSRA\" --model \"bvae\" --auto-load --auto-save --beta 15.0 --train --train-dir \"../data/preprocessed/train_msra_merged.npz\" --validation-dir \"../data/preprocessed/validate_msra_merged.npz\" --test-dir \"../data/preprocessed/test_msra_merged.npz\"\n```\n\n## Test\n\n```txt\nmain.py --basename \"HandPoseShapeVAE_MSRA\" --model \"bvae\" --auto-load --auto-save --beta 15.0 --test --train-dir \"../data/preprocessed/train_msra_merged.npz\" --validation-dir \"../data/preprocessed/validate_msra_merged.npz\" --test-dir \"../data/preprocessed/test_msra_merged.npz\"\n```\n\n## Experiments\n\n```txt\nmain.py --basename \"HandPoseShapeVAE_MSRA\" --model \"bvae\" --auto-load --auto-save --beta 15.0 --experiments --traverse-latents --train-dir \"../data/preprocessed/train_msra_merged.npz\" --validation-dir \"../data/preprocessed/validate_msra_merged.npz\" --test-dir \"../data/preprocessed/test_msra_merged.npz\"\n```\n\n```txt\nmain.py --basename \"HandPoseShapeVAE_MSRA\" --model \"bvae\" --auto-load --auto-save --beta 15.0 --experiments --train-joints --train-dir \"../data/preprocessed/train_msra_merged.npz\" --validation-dir \"../data/preprocessed/validate_msra_merged.npz\" --test-dir \"../data/preprocessed/test_msra_merged.npz\"\n```\n\n![](gif/traverse_rendered_bvae_shape_bvae_10.gif)\n![](gif/traverse_msra_bvae_bvae_10.gif)\n![](gif/traverse_rendered_bvae_spread_bvae_10.gif)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdakup%2Fhandposeshapevae","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdakup%2Fhandposeshapevae","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdakup%2Fhandposeshapevae/lists"}