{"id":16107774,"url":"https://github.com/jhj0517/stable-diffusion-webui-musepose","last_synced_at":"2025-03-18T08:32:31.447Z","repository":{"id":243052048,"uuid":"810871916","full_name":"jhj0517/stable-diffusion-webui-MusePose","owner":"jhj0517","description":"MusePose extension for stable-diffusion-webui","archived":false,"fork":false,"pushed_at":"2024-06-14T07:18:18.000Z","size":151,"stargazers_count":5,"open_issues_count":2,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-09T21:09:35.464Z","etag":null,"topics":["ai","gradio","open-source","python","stable-diffusion","stable-diffusion-webui-plugin"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jhj0517.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-05T14:03:55.000Z","updated_at":"2024-07-06T03:12:46.000Z","dependencies_parsed_at":"2024-06-13T13:03:53.541Z","dependency_job_id":"7b0ca1d0-f9dd-41ed-bb18-1966c616a040","html_url":"https://github.com/jhj0517/stable-diffusion-webui-MusePose","commit_stats":null,"previous_names":["jhj0517/stable-diffusion-webui-musepose"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jhj0517%2Fstable-diffusion-webui-MusePose","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jhj0517%2Fstable-diffusion-webui-MusePose/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jhj0517%2Fstable-diffusion-webui-MusePose/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jhj0517%2Fstable-diffusion-webui-MusePose/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jhj0517","download_url":"https://codeload.github.com/jhj0517/stable-diffusion-webui-MusePose/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243910750,"owners_count":20367544,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","gradio","open-source","python","stable-diffusion","stable-diffusion-webui-plugin"],"created_at":"2024-10-09T19:24:26.107Z","updated_at":"2025-03-18T08:32:31.102Z","avatar_url":"https://github.com/jhj0517.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# MusePose SD WebUI Extension\n[MusePose](https://github.com/TMElyralab/MusePose) extension for the [SD WebUI](https://github.com/AUTOMATIC1111/stable-diffusion-webui).\n![screenshot](https://github.com/jhj0517/stable-diffusion-webui-MusePose/assets/97279763/aa982503-50c2-4093-9319-38510d51160b)\n\n\n## OverView\nWhen running, this will download a **total of 9 models** (15GB total) to your `path_to_sd_webui\\models\\` directory if there are no models.\n```\n./models/\n|-- MusePose\n|   |-- denoising_unet.pth\n|   |-- motion_module.pth\n|   |-- pose_guider.pth\n|   └── reference_unet.pth\n|-- dwpose\n|   |-- dw-ll_ucoco_384.pth\n|   └── yolox_l_8x8_300e_coco.pth\n|-- sd-image-variations-diffusers\n|   └── unet\n|       |-- config.json\n|       └── diffusion_pytorch_model.bin\n|-- image_encoder\n|   |-- config.json\n|   └── pytorch_model.bin\n└── sd-vae-ft-mse\n    |-- config.json\n    └── diffusion_pytorch_model.bin\n```\nYou can also manually download the models in the links [here](https://github.com/TMElyralab/MusePose?tab=readme-ov-file#download-weights), if you want.\n\nMusePose works through a two step process.\n \nStep1 - Extract pose (skeleton) video from input dance video \u0026 input image.\u003cbr\u003e\nThese models will be used for this step:\n- `yolox_l_8x8_300e_coco.pth`\n- `dw-ll_ucoco_384.pth`\n  \nThe extracted pose video output will be saved in `path_to_sd_webui\\outputs\\MusePose\\aligned_pose`.\n\nStep2 - Make the image move from the input image \u0026 the extracted pose video.\u003cbr\u003e\nThese models will be used for this step:\n- `denoising_unet.pth`\n- `motion_module.pth`\n- `pose_guider.pth`\n- `reference_unet.pth`\n- `sd-image-variations-diffusers`\n- `image_encoder`\n- `sd-vae-ft-mse`\n\nThe output will be saved in \n`path_to_sd_webui\\outputs\\MusePose\\inference_musepose`\n\n# How to Install \u0026 Use\n- Download \u0026 unzip this [repository](https://github.com/jhj0517/stable-diffusion-webui-MusePose/zipball/master) to `path_to_sd_webui\\extensions\\`\n- Input image \u0026 input dancing video and click \"ALIGN POSE\" button in **Pose Alignment** tab.\u003cbr\u003e\nThe output will be saved in `path_to_sd_webui\\outputs\\MusePose\\pose_alignment`.\n- Input image \u0026 input the extract pose video from step1 and click \"GENERATE\" button in **MusePose Inference** tab.\u003cbr\u003e\nThe output will be saved in `path_to_sd_webui\\outputs\\MusePose\\musepose_inference`. \n\n# Troubleshooting For Installation\nIf you encounter error during installation and the MusePose tab doesn't appear, it's because WebUI's venv prevents installing some dependencies.\u003cbr\u003e\nTo fix this, you need to manually activate the venv and install these packages. \n1. Open the terminal in the WebUI and activate the venv\n```\nC:\\YourPath\\To_SD_WebUI\u003evenv\\Scripts\\activate\n```\nThen it will display (venv) in front of the terminal like this.\n```\n(venv) C:\\YourPath\\To_SD_WebUI\u003e\n```\n2. In this state, run\n```\npip uninstall opencv-python-headless\npip uninstall opencv-python\npip uninstall opencv-contrib-python\npip install opencv-python\npip install opencv-contrib-python\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjhj0517%2Fstable-diffusion-webui-musepose","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjhj0517%2Fstable-diffusion-webui-musepose","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjhj0517%2Fstable-diffusion-webui-musepose/lists"}