{"id":13488981,"url":"https://github.com/magic-research/magic-animate","last_synced_at":"2025-05-14T02:08:25.798Z","repository":{"id":208660715,"uuid":"721522144","full_name":"magic-research/magic-animate","owner":"magic-research","description":"[CVPR 2024] MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model","archived":false,"fork":false,"pushed_at":"2024-06-21T20:23:43.000Z","size":25460,"stargazers_count":10718,"open_issues_count":107,"forks_count":1095,"subscribers_count":104,"default_branch":"main","last_synced_at":"2025-04-10T22:18:40.140Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://showlab.github.io/magicanimate/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/magic-research.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-11-21T08:33:54.000Z","updated_at":"2025-04-10T16:59:31.000Z","dependencies_parsed_at":"2023-12-19T07:53:39.528Z","dependency_job_id":"8556b564-90b4-4081-aa9e-ffcc61486cde","html_url":"https://github.com/magic-research/magic-animate","commit_stats":null,"previous_names":["magic-research/magic-animate"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/magic-research%2Fmagic-animate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/magic-research%2Fmagic-animate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/magic-research%2Fmagic-animate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/magic-research%2Fmagic-animate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/magic-research","download_url":"https://codeload.github.com/magic-research/magic-animate/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254053170,"owners_count":22006717,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T18:01:25.554Z","updated_at":"2025-05-14T02:08:20.786Z","avatar_url":"https://github.com/magic-research.png","language":"Python","funding_links":[],"categories":["Video Generation","Python","其他_机器视觉","Repos"],"sub_categories":["网络服务_其他"],"readme":"\u003c!-- # magic-edit.github.io --\u003e\n\n\u003cp align=\"center\"\u003e\n\n  \u003ch2 align=\"center\"\u003eMagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model\u003c/h2\u003e\n  \u003cp align=\"center\"\u003e\n    \u003ca href=\"https://scholar.google.com/citations?user=-4iADzMAAAAJ\u0026hl=en\"\u003e\u003cstrong\u003eZhongcong Xu\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"http://jeff95.me/\"\u003e\u003cstrong\u003eJianfeng Zhang\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"https://scholar.google.com.sg/citations?user=8gm-CYYAAAAJ\u0026hl=en\"\u003e\u003cstrong\u003eJun Hao Liew\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"https://hanshuyan.github.io/\"\u003e\u003cstrong\u003eHanshu Yan\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"https://scholar.google.com/citations?user=stQQf7wAAAAJ\u0026hl=en\"\u003e\u003cstrong\u003eJia-Wei Liu\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"https://zhangchenxu528.github.io/\"\u003e\u003cstrong\u003eChenxu Zhang\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"https://sites.google.com/site/jshfeng/home\"\u003e\u003cstrong\u003eJiashi Feng\u003c/strong\u003e\u003c/a\u003e\n    ·\n    \u003ca href=\"https://sites.google.com/view/showlab\"\u003e\u003cstrong\u003eMike Zheng Shou\u003c/strong\u003e\u003c/a\u003e\n    \u003cbr\u003e\n    \u003cbr\u003e\n        \u003ca href=\"https://arxiv.org/abs/2311.16498\"\u003e\u003cimg src='https://img.shields.io/badge/arXiv-MagicAnimate-red' alt='Paper PDF'\u003e\u003c/a\u003e\n        \u003ca href='https://showlab.github.io/magicanimate'\u003e\u003cimg src='https://img.shields.io/badge/Project_Page-MagicAnimate-green' alt='Project Page'\u003e\u003c/a\u003e\n        \u003ca href='https://huggingface.co/spaces/zcxu-eric/magicanimate'\u003e\u003cimg src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue'\u003e\u003c/a\u003e\n    \u003cbr\u003e\n    \u003cb\u003eNational University of Singapore \u0026nbsp; | \u0026nbsp;  ByteDance\u003c/b\u003e\n  \u003c/p\u003e\n  \n  \u003ctable align=\"center\"\u003e\n    \u003ctr\u003e\n    \u003ctd\u003e\n      \u003cimg src=\"assets/teaser/t4.gif\"\u003e\n    \u003c/td\u003e\n    \u003ctd\u003e\n      \u003cimg src=\"assets/teaser/t2.gif\"\u003e\n    \u003c/td\u003e\n    \u003c/tr\u003e\n  \u003c/table\u003e\n\n## 📢 News\n* **[2023.12.4]** Release inference code and gradio demo. We are working to improve MagicAnimate, stay tuned!\n* **[2023.11.23]** Release MagicAnimate paper and project page.\n\n## 🏃‍♂️ Getting Started\nDownload the pretrained base models for [StableDiffusion V1.5](https://huggingface.co/runwayml/stable-diffusion-v1-5) and [MSE-finetuned VAE](https://huggingface.co/stabilityai/sd-vae-ft-mse).\n\nDownload our MagicAnimate [checkpoints](https://huggingface.co/zcxu-eric/MagicAnimate).\n\nPlease follow the huggingface download instructions to download the above models and checkpoints, `git lfs` is recommended.\n\nPlace the based models and checkpoints as follows:\n```bash\nmagic-animate\n|----pretrained_models\n  |----MagicAnimate\n    |----appearance_encoder\n      |----diffusion_pytorch_model.safetensors\n      |----config.json\n    |----densepose_controlnet\n      |----diffusion_pytorch_model.safetensors\n      |----config.json\n    |----temporal_attention\n      |----temporal_attention.ckpt\n  |----sd-vae-ft-mse\n    |----config.json\n    |----diffusion_pytorch_model.safetensors\n  |----stable-diffusion-v1-5\n    |----scheduler\n       |----scheduler_config.json\n    |----text_encoder\n       |----config.json\n       |----pytorch_model.bin\n    |----tokenizer (all)\n    |----unet\n       |----diffusion_pytorch_model.bin\n       |----config.json\n    |----v1-5-pruned-emaonly.safetensors\n|----...\n```\n\n## ⚒️ Installation\nprerequisites: `python\u003e=3.8`, `CUDA\u003e=11.3`, and `ffmpeg`.\n\nInstall with `conda`: \n```bash\nconda env create -f environment.yaml\nconda activate manimate\n```\nor `pip`:\n```bash\npip3 install -r requirements.txt\n```\n\n## 💃 Inference\nRun inference on single GPU:\n```bash\nbash scripts/animate.sh\n```\nRun inference with multiple GPUs:\n```bash\nbash scripts/animate_dist.sh\n```\n\n## 🎨 Gradio Demo \n\n#### Online Gradio Demo:\nTry our [online gradio demo](https://huggingface.co/spaces/zcxu-eric/magicanimate) quickly.\n\n#### Local Gradio Demo:\nLaunch local gradio demo on single GPU:\n```bash\npython3 -m demo.gradio_animate\n```\nLaunch local gradio demo if you have multiple GPUs:\n```bash\npython3 -m demo.gradio_animate_dist\n```\nThen open gradio demo in local browser.\n\n## 🙏 Acknowledgements\nWe would like to thank [AK(@_akhaliq)](https://twitter.com/_akhaliq?lang=en) and huggingface team for the help of setting up oneline gradio demo.\n\n## 🎓 Citation\nIf you find this codebase useful for your research, please use the following entry.\n```BibTeX\n@inproceedings{xu2023magicanimate,\n    author    = {Xu, Zhongcong and Zhang, Jianfeng and Liew, Jun Hao and Yan, Hanshu and Liu, Jia-Wei and Zhang, Chenxu and Feng, Jiashi and Shou, Mike Zheng},\n    title     = {MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model},\n    booktitle = {arXiv},\n    year      = {2023}\n}\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmagic-research%2Fmagic-animate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmagic-research%2Fmagic-animate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmagic-research%2Fmagic-animate/lists"}