{"id":14633243,"url":"https://github.com/mayuelala/followyourpose","last_synced_at":"2025-05-16T02:05:47.685Z","repository":{"id":150594984,"uuid":"621346074","full_name":"mayuelala/FollowYourPose","owner":"mayuelala","description":"[AAAI 2024] Follow-Your-Pose: This repo is the official implementation of \"Follow-Your-Pose : Pose-Guided Text-to-Video Generation using Pose-Free Videos\"   ","archived":false,"fork":false,"pushed_at":"2024-03-20T01:44:18.000Z","size":284562,"stargazers_count":1315,"open_issues_count":12,"forks_count":93,"subscribers_count":25,"default_branch":"main","last_synced_at":"2025-05-16T02:05:02.457Z","etag":null,"topics":["aaai-2024","aigc","follow-your-pose","laion-pose-dataset","video-generation"],"latest_commit_sha":null,"homepage":"https://follow-your-pose.github.io/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mayuelala.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2023-03-30T13:32:19.000Z","updated_at":"2025-05-12T04:03:06.000Z","dependencies_parsed_at":"2023-06-10T08:30:38.808Z","dependency_job_id":"7e3759b6-0221-4a5f-b230-e015d287690d","html_url":"https://github.com/mayuelala/FollowYourPose","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mayuelala%2FFollowYourPose","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mayuelala%2FFollowYourPose/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mayuelala%2FFollowYourPose/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mayuelala%2FFollowYourPose/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mayuelala","download_url":"https://codeload.github.com/mayuelala/FollowYourPose/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254453651,"owners_count":22073617,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aaai-2024","aigc","follow-your-pose","laion-pose-dataset","video-generation"],"created_at":"2024-09-09T17:02:00.557Z","updated_at":"2025-05-16T02:05:47.668Z","avatar_url":"https://github.com/mayuelala.png","language":"Python","funding_links":[],"categories":["Pose Guided Human Video Generation"],"sub_categories":["Co-Speech Gesture Video Generation"],"readme":"\u003cdiv align=\"center\"\u003e\n\u003ch2\u003e\u003cfont color=\"red\"\u003e 🕺🕺🕺 Follow-Your-Pose 💃💃💃 \u003c/font\u003e\u003c/center\u003e \u003cbr\u003e \u003ccenter\u003ePose-Guided Text-to-Video Generation using Pose-Free Videos (AAAI 2024)\u003c/h2\u003e\n\n[Yue Ma*](https://mayuelala.github.io/), [Yingqing He*](https://github.com/YingqingHe), [Xiaodong Cun](http://vinthony.github.io/), [Xintao Wang](https://xinntao.github.io/), [Siran Chen](https://github.com/Sranc3), [Ying Shan](https://scholar.google.com/citations?hl=zh-CN\u0026user=4oXBp9UAAAAJ), [Xiu Li](https://scholar.google.com/citations?user=Xrh1OIUAAAAJ\u0026hl=zh-CN), and [Qifeng Chen](https://cqf.io)\n\n\u003ca href='https://arxiv.org/abs/2304.01186'\u003e\u003cimg src='https://img.shields.io/badge/ArXiv-2304.01186-red'\u003e\u003c/a\u003e \n\u003ca href='https://follow-your-pose.github.io/'\u003e\u003cimg src='https://img.shields.io/badge/Project-Page-Green'\u003e\u003c/a\u003e  [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/mayuelala/FollowYourPose/blob/main/quick_demo.ipynb) [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/YueMafighting/FollowYourPose) [![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/houshaowei/FollowYourPose) ![visitors](https://visitor-badge.laobi.icu/badge?page_id=mayuelala.FollowYourPose\u0026left_color=green\u0026right_color=red)  [![GitHub](https://img.shields.io/github/stars/mayuelala/FollowYourPose?style=social)](https://github.com/mayuelala/FollowYourPose) \n\u003c/div\u003e\n\n\n\u003c!-- ![fatezero_demo](./docs/teaser.png) --\u003e\n\n\u003ctable class=\"center\"\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_man_in_the_park.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_Iron_man_in_the_street.gif\"\u003e\u003c/td\u003e\n  \u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"The man is sitting on chair, on the park\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"The Iron man, on the street\n\"\u003c/td\u003e\n  \u003c!-- \u003ctd width=25% style=\"text-align:center;\"\u003e\"Wonder Woman, wearing a cowboy hat, is skiing\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A man, wearing pink clothes, is skiing at sunset\"\u003c/td\u003e --\u003e\n\u003c/tr\u003e\n\u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_strom.gif\"\u003e\u003c/td\u003e\n\u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_astronaut_cartoon.gif\"\u003e\u003c/td\u003e\n\u003ctr\u003e\n\u003ctd width=25% style=\"text-align:center;\"\u003e\"The stormtrooper, in the gym\n\"\u003c/td\u003e\n\u003ctd width=25% style=\"text-align:center;\"\u003e\"The astronaut, earth background, Cartoon Style\n\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table \u003e\n\n## 💃💃💃 Demo Video\n\n\n\nhttps://github.com/mayuelala/FollowYourPose/assets/38033523/e021bce6-b9bd-474d-a35a-7ddff4ab8e75\n\n\n## 💃💃💃 Abstract\n\u003cb\u003eTL;DR: We tune the text-to-image model (e.g., stable diffusion) to generate the character videos from pose and text description.\u003c/b\u003e\n\n\u003cdetails\u003e\u003csummary\u003eCLICK for full abstract\u003c/summary\u003e\n\n\n\u003e Generating text-editable and pose-controllable character videos have an imperious demand in creating various digital human. Nevertheless, this task has been restricted by the absence of a comprehensive dataset featuring paired video-pose captions and the generative prior models for videos. In this work, we design a novel two-stage training scheme that can utilize easily obtained datasets (i.e., image pose pair and pose-free video) and the pre-trained text-to-image (T2I) model to obtain the pose-controllable character videos. Specifically, in the first stage, only the keypoint-image pairs are used only for a controllable textto-image generation. We learn a zero-initialized convolutional encoder to encode the pose information. In the second stage, we finetune the motion of the above network via a pose-free video dataset by adding the learnable temporal self-attention and reformed cross-frame self-attention blocks. Powered by our new designs, our method successfully generates continuously pose-controllable character videos while keeps the editing and concept composition ability of the pre-trained T2I model. The code and models will be made publicly available.\n\u003c/details\u003e\n\n## 🕺🕺🕺 Changelog\n\u003c!-- A new option store all the attentions in hard disk, which require less ram. --\u003e\n- **[2024.03.15]** 🔥 🔥 🔥 We release the Second Follower [Follow-Your-Click](https://follow-your-click.github.io/), the first framework to achieve regional image animation. Try it now! Please give us a star! ⭐️⭐️⭐️ 😄\n- **[2023.12.09]** 🔥 The paper is accepted by AAAI 2024!\n- **[2023.08.30]** 🔥 Release some new results!\n- **[2023.07.06]** 🔥 Release A new version of `浦源内容平台 demo` [![浦源内容平台 Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20%E6%B5%A6%E6%BA%90%E5%86%85%E5%AE%B9%E5%B9%B3%E5%8F%B0-Spaces-blue)](https://openxlab.org.cn/apps/detail/houshaowei/FollowYourPose)! Thanks for the support of Shanghai AI Lab!\n- **[2023.04.12]** 🔥 Release local gradio demo and you could run it locally, only need a A100/3090. \n- **[2023.04.11]** 🔥 Release some cases in `huggingface demo`. \n- **[2023.04.10]** 🔥 Release A new version of `huggingface demo` [![Hugging Face Spaces](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Spaces-blue)](https://huggingface.co/spaces/YueMafighting/FollowYourPose), which support both `raw video` and `skeleton video` as input. Enjoy it!\n- **[2023.04.07]** Release the first version of  `huggingface demo`. Enjoy the fun of following your pose! You need to download the [skeleton video](https://github.com/mayuelala/FollowYourPose/tree/main/pose_example) or make your own skeleton video by [mmpose](https://mmpose.readthedocs.io/en/latest/model_zoo_papers/backbones.html#hrnet-cvpr-2019).  Additionaly, the second version which regard the `video format` as input is comming.\n- **[2023.04.07]** Release a `colab notebook` [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/mayuelala/FollowYourPose/blob/main/quick_demo.ipynb) and updata the `requirements` for installation!\n- **[2023.04.06]** Release `code`, `config` and `checkpoints`!\n- **[2023.04.03]** Release Paper and Project page!\n\n## 💃💃💃 HuggingFace Demo\n\u003ctable class=\"center\"\u003e\n  \u003ctd\u003e\u003cimg src=\"https://user-images.githubusercontent.com/38033523/231338219-94b54b10-3fdc-4bf5-9e07-0c1ff236793a.png\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"https://user-images.githubusercontent.com/38033523/231337960-a30db639-2ecc-486f-8d95-3b3e9c2ed338.png\"\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n\n## 🎤🎤🎤 Todo\n\n- [X] Release the code, config and checkpoints for teaser\n- [X] Colab\n- [X] Hugging face gradio demo\n- [ ] Release more applications\n\n\n## 🍻🍻🍻 Setup Environment\nOur method is trained using cuda11, accelerator and xformers on 8 A100.\n``` \nconda create -n fupose python=3.8\nconda activate fupose\n\npip install -r requirements.txt\n``` \n\n`xformers` is recommended for A100 GPU to save memory and running time. \n\n\u003cdetails\u003e\u003csummary\u003eClick for xformers installation \u003c/summary\u003e\n\nWe find its installation not stable. You may try the following wheel:\n\n```bash\nwget https://github.com/ShivamShrirao/xformers-wheels/releases/download/4c06c79/xformers-0.0.15.dev0+4c06c79.d20221201-cp38-cp38-linux_x86_64.whl\npip install xformers-0.0.15.dev0+4c06c79.d20221201-cp38-cp38-linux_x86_64.whl\n```\n\u003c/details\u003e\n\nOur environment is similar to Tune-A-video ([official](https://github.com/showlab/Tune-A-Video), [unofficial](https://github.com/bryandlee/Tune-A-Video)). You may check them for more details.\n\n## 💃💃💃 Training\nWe fix the bug in Tune-a-video and finetune stable diffusion-1.4 on 8 A100.\nTo fine-tune the text-to-image diffusion models for text-to-video generation, run this command:\n\n```bash\nTORCH_DISTRIBUTED_DEBUG=DETAIL accelerate launch \\\n    --multi_gpu --num_processes=8 --gpu_ids '0,1,2,3,4,5,6,7' \\\n    train_followyourpose.py \\\n    --config=\"configs/pose_train.yaml\" \n```\n\n## 🕺🕺🕺 Inference\nOnce the training is done, run inference:\n\n```bash\nTORCH_DISTRIBUTED_DEBUG=DETAIL accelerate launch \\\n    --gpu_ids '0' \\\n    txt2video.py \\\n    --config=\"configs/pose_sample.yaml\" \\\n    --skeleton_path=\"./pose_example/vis_ikun_pose2.mov\"\n```\nYou could make the pose video by [mmpose](https://github.com/open-mmlab/mmpose) , we detect the skeleton by [HRNet](https://mmpose.readthedocs.io/en/latest/model_zoo_papers/backbones.html#hrnet-cvpr-2019).  You just need to run the video demo to obtain the pose video.  Remember to replace the background with black.\n\n\n## 💃💃💃 Local Gradio Demo\nYou could run the gradio demo locally, only need a `A100/3090`.\n```bash\npython app.py\n```\nthen the demo is running on local URL:  `http://0.0.0.0:Port`\n\n## 🕺🕺🕺 Weight\n[Stable Diffusion] [Stable Diffusion](https://arxiv.org/abs/2112.10752) is a latent text-to-image diffusion model capable of generating photo-realistic images given any text input. The pre-trained Stable Diffusion models can be downloaded from Hugging Face (e.g., [Stable Diffusion v1-4](https://huggingface.co/CompVis/stable-diffusion-v1-4))\n\n\n[FollowYourPose] We also provide our pretrained checkpoints in [Huggingface](https://huggingface.co/YueMafighting/FollowYourPose_v1/tree/main). you could download them and put them into `checkpoints` folder to inference our models.\n\n\n```bash\nFollowYourPose\n├── checkpoints\n│   ├── followyourpose_checkpoint-1000\n│   │   ├──...\n│   ├── stable-diffusion-v1-4\n│   │   ├──...\n│   └── pose_encoder.pth\n```\n\n\n## 💃💃💃 Results\nWe show our results regarding various pose sequences and text prompts.\n\nNote mp4 and gif files in this github page are compressed. \nPlease check our [Project Page](https://follow-your-pose.github.io/) for mp4 files of original video results.\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/Trump_on_the_mountain.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/Trump_wear_yellow.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/astranaut_on_the_mountain.gif\"\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Trump, on the mountain\n\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"man, on the mountain\n\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"astronaut, on mountain\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_girl_yellow.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_Iron_man_on_the_beach.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/hulk_on_the_mountain.gif\"\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"girl, simple background\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Iron man, on the beach\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Hulk, on the mountain\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_policeman_in_the_street.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/a_girl_in_the_forest.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/new_result_0830/Iron_man_in_the_street.gif\"\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A policeman, on the street\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A girl, in the forest\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Iron man, on the street\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/A Robot is dancing in Sahara desert.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/sdsdA Iron man on the beach.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/A Panda on the sea.gif\"\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Robot, in Sahara desert\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Iron man, on the beach\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A panda, son the sea\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/a man in the park, Van Gogh style.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/fireman in the beach.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/Batman brown background.gif\"\u003e\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A man in the park, Van Gogh style\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"The fireman in the beach\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Batman, brown background\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/ertA Hulk on the sea .gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/lokA Superman on the forest.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/A Iron man on the snow.gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Hulk, on the sea\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A superman, in the forest\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Iron man, in the snow\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/A man in the forest, Minecraft.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/a man in the sea, at sunset.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/James Bond, grey simple background.gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A man in the forest, Minecraft.\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A man in the sea, at sunset\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"James Bond, grey simple background\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/vryvA Panda on the sea.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/nbthA Stormtrooper on the sea.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/egbA astronaut on the moon.gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Panda on the sea.\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Stormtrooper on the sea\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A astronaut on the moon\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/sssA astronaut on the moon.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/ccA Robot in Antarctica.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/zzzzA Iron man on the beach..gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A astronaut on the moon.\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Robot in Antarctica.\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Iron man on the beach.\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n\u003c!--#########################################################--\u003e\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/yrvA Obama in the desert.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/dfcA Astronaut on the beach.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/sasqA Iron man on the snow.gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"The Obama in the desert\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Astronaut on the beach.\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Iron man on the snow\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/aaaA Stormtrooper on the sea.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/A Iron man on the beach..gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/A astronaut on the moon.gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Stormtrooper on the sea\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A Iron man on the beach.\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"A astronaut on the moon.\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/cdAstronaut on the beach.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/cswSuperman on the forest.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/cwIron man on the beach..gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Astronaut on the beach\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Superman on the forest\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Iron man on the beach\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\u003ctable class=\"center\"\u003e\n\u003ctr\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/dfewcAstronaut on the beach.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/ewA Robot in Antarctica.gif\"\u003e\u003c/td\u003e\n  \u003ctd\u003e\u003cimg src=\"gif_results/vervA Stormtrooper on the sea.gif\"\u003e\u003c/td\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n\n\u003c/tr\u003e\n\u003ctr\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Astronaut on the beach\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"Robot in Antarctica\"\u003c/td\u003e\n  \u003ctd width=25% style=\"text-align:center;\"\u003e\"The Stormtroopers, on the beach\"\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\u003c!--#########################################################--\u003e\n\n\n\n\n## 🎼🎼🎼 Citation \nIf you think this project is helpful, please feel free to leave a star⭐️⭐️⭐️ and cite our paper:\n```bibtex\n@article{ma2023follow,\n  title={Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videos},\n  author={Ma, Yue and He, Yingqing and Cun, Xiaodong and Wang, Xintao and Shan, Ying and Li, Xiu and Chen, Qifeng},\n  journal={arXiv preprint arXiv:2304.01186},\n  year={2023}\n}\n``` \n\n\n## 👯👯👯 Acknowledgements\n\nThis repository borrows heavily from [Tune-A-Video](https://github.com/showlab/Tune-A-Video) and [FateZero](https://github.com/ChenyangQiQi/FateZero). thanks the authors for sharing their code and models.\n\n## 🕺🕺🕺 Maintenance\n\nThis is the codebase for our research work. We are still working hard to update this repo and more details are coming in days. If you have any questions or ideas to discuss, feel free to contact [Yue Ma](mailto:y-ma21@mails.tsinghua.edu.cn) or [Yingqing He](https://github.com/YingqingHe) or [Xiaodong Cun](mailto:vinthony@gmail.com).\n\n## ⭐️⭐️⭐️ Star History\n\n[![Star History Chart](https://api.star-history.com/svg?repos=mayuelala/FollowYourPose\u0026type=Date)](https://star-history.com/#mayuelala/FollowYourPose\u0026Date)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmayuelala%2Ffollowyourpose","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmayuelala%2Ffollowyourpose","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmayuelala%2Ffollowyourpose/lists"}