{"id":23234057,"url":"https://github.com/AIFSH/ComfyUI-MuseTalk_FSH","last_synced_at":"2025-08-19T19:33:09.925Z","repository":{"id":233787057,"uuid":"787812158","full_name":"AIFSH/ComfyUI-MuseTalk_FSH","owner":"AIFSH","description":"the comfyui custom node of MuseTalk to make audio driven videos!","archived":false,"fork":false,"pushed_at":"2024-06-14T07:05:19.000Z","size":2640,"stargazers_count":17,"open_issues_count":9,"forks_count":5,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-11-28T03:02:56.487Z","etag":null,"topics":["comfyui-nodes","lipsync","musetalk"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AIFSH.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-04-17T08:24:27.000Z","updated_at":"2024-11-25T04:19:38.000Z","dependencies_parsed_at":"2024-05-17T07:41:04.924Z","dependency_job_id":"7e8bbee5-4eea-4947-a50b-a47c01ae0b1d","html_url":"https://github.com/AIFSH/ComfyUI-MuseTalk_FSH","commit_stats":null,"previous_names":["aifsh/comfyui-musetalk_fsh"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AIFSH%2FComfyUI-MuseTalk_FSH","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AIFSH%2FComfyUI-MuseTalk_FSH/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AIFSH%2FComfyUI-MuseTalk_FSH/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AIFSH%2FComfyUI-MuseTalk_FSH/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AIFSH","download_url":"https://codeload.github.com/AIFSH/ComfyUI-MuseTalk_FSH/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":230367781,"owners_count":18215326,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["comfyui-nodes","lipsync","musetalk"],"created_at":"2024-12-19T03:02:11.647Z","updated_at":"2025-08-19T19:33:09.906Z","avatar_url":"https://github.com/AIFSH.png","language":"Python","funding_links":[],"categories":["Workflows (3395) sorted by GitHub Stars","All Workflows Sorted by GitHub Stars"],"sub_categories":[],"readme":"# ComfyUI-MuseTalk_FSH\nthe comfyui custom node of [MuseTalk](https://github.com/TMElyralab/MuseTalk.git) to make audio driven videos!\n\u003cdiv\u003e\n  \u003cfigure\u003e\n  \u003cimg alt='webpage' src=\"web.png?raw=true\" width=\"600px\"/\u003e\n  \u003cfigure\u003e\n\u003c/div\u003e\n\n## How to use\nmake sure `ffmpeg` is worked in your commandline\nfor Linux\n```\napt update\napt install ffmpeg\n```\nfor Windows,you can install `ffmpeg` by [WingetUI](https://github.com/marticliment/WingetUI) automatically\n\nthen!\n```\ngit clone https://github.com/AIFSH/ComfyUI-MuseTalk_FSH.git\ncd ComfyUI-MuseTalk_FSH\npip install -r requirements.txt\n```\n### mmlab packages\n```bash\npip install --no-cache-dir -U openmim \nmim install mmengine \nmim install \"mmcv\u003e=2.0.1\" \nmim install \"mmdet\u003e=3.1.0\" \nmim install \"mmpose\u003e=1.1.0\" \n```\n\n### Download weights\nYou can download weights manually as follows:\n\n1. Download our trained [weights](https://huggingface.co/TMElyralab/MuseTalk).\n\n2. Download the weights of other components:\n   - [sd-vae-ft-mse](https://huggingface.co/stabilityai/sd-vae-ft-mse)\n   - [whisper](https://openaipublic.azureedge.net/main/whisper/models/65147644a518d12f04e32d6f3b26facc3f8dd46e5390956a9424a650c0ce22b9/tiny.pt)\n   - [dwpose](https://huggingface.co/yzd-v/DWPose/tree/main)\n   - [face-parse-bisent](https://github.com/zllrunning/face-parsing.PyTorch)\n   - [resnet18](https://download.pytorch.org/models/resnet18-5c106cde.pth)\n\n或者下载[MuseTalk.zip](https://pan.quark.cn/s/d6e76084ae92)，\n解压后把子文件夹放入`ComfyUI-MuseTalk_FSH/models/`目录\n\nFinally, these weights should be organized in `models` as follows:\n```\nComfyUI-MuseTalk_FSH/models/\n├── musetalk\n│   └── musetalk.json\n│   └── pytorch_model.bin\n├── dwpose\n│   └── dw-ll_ucoco_384.pth\n├── face-parse-bisent\n│   ├── 79999_iter.pth\n│   └── resnet18-5c106cde.pth\n├── sd-vae-ft-mse\n│   ├── config.json\n│   └── diffusion_pytorch_model.bin\n└── whisper\n    └── tiny.pt\n```\n\n## Tutorial\n- [Demo on 3060 12GB](https://www.bilibili.com/video/BV1St421w7Qn)\n- [Demo on 4090 24GB](https://www.bilibili.com/video/BV13T42117uM/)\n\n\n## WeChat Group \u0026\u0026 Donate\n\u003cdiv\u003e\n  \u003cfigure\u003e\n  \u003cimg alt='Wechat' src=\"wechat.jpg?raw=true\" width=\"300px\"/\u003e\n  \u003cimg alt='donate' src=\"donate.jpg?raw=true\" width=\"300px\"/\u003e\n  \u003cfigure\u003e\n\u003c/div\u003e\n    \n## Thanks\n- [MuseTalk](https://github.com/TMElyralab/MuseTalk.git) \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FAIFSH%2FComfyUI-MuseTalk_FSH","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FAIFSH%2FComfyUI-MuseTalk_FSH","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FAIFSH%2FComfyUI-MuseTalk_FSH/lists"}