{"id":25546729,"url":"https://github.com/SkyworkAI/SkyReels-A1","last_synced_at":"2026-02-11T03:30:17.503Z","repository":{"id":278106780,"uuid":"931887169","full_name":"SkyworkAI/SkyReels-A1","owner":"SkyworkAI","description":"SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers","archived":false,"fork":false,"pushed_at":"2025-02-18T02:17:19.000Z","size":50238,"stargazers_count":26,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-18T03:24:11.231Z","etag":null,"topics":["condition-render","video-diffusion"],"latest_commit_sha":null,"homepage":"https://www.skyreels.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/SkyworkAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-13T02:37:51.000Z","updated_at":"2025-02-18T03:15:55.000Z","dependencies_parsed_at":"2025-02-18T03:34:18.346Z","dependency_job_id":null,"html_url":"https://github.com/SkyworkAI/SkyReels-A1","commit_stats":null,"previous_names":["skyworkai/skyreels-a1"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyworkAI%2FSkyReels-A1","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyworkAI%2FSkyReels-A1/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyworkAI%2FSkyReels-A1/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyworkAI%2FSkyReels-A1/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/SkyworkAI","download_url":"https://codeload.github.com/SkyworkAI/SkyReels-A1/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239808519,"owners_count":19700449,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["condition-render","video-diffusion"],"created_at":"2025-02-20T09:01:48.882Z","updated_at":"2026-02-11T03:30:17.449Z","avatar_url":"https://github.com/SkyworkAI.png","language":"Python","funding_links":[],"categories":["\u003cspan id=\"video\"\u003eVideo\u003c/span\u003e","Poster"],"sub_categories":["\u003cspan id=\"tool\"\u003eLLM (LLM \u0026 Tool)\u003c/span\u003e"],"readme":"\u003cp align=\"center\"\u003e\n  \u003cimg src=\"assets/logo.png\" alt=\"Skyreels Logo\" width=\"50%\"\u003e\n\u003c/p\u003e\n\n\n\u003ch1 align=\"center\"\u003eSkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers\u003c/h1\u003e\n\u003cdiv align='center'\u003e\n    \u003ca href='https://scholar.google.com/citations?user=6D_nzucAAAAJ\u0026hl=en' target='_blank'\u003e\u003cstrong\u003eDi Qiu\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n    \u003ca href='https://scholar.google.com/citations?user=_43YnBcAAAAJ\u0026hl=zh-CN' target='_blank'\u003e\u003cstrong\u003eZhengcong Fei\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n    \u003ca target='_blank'\u003e\u003cstrong\u003eRui Wang\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n    \u003ca target='_blank'\u003e\u003cstrong\u003eJialin Bai\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n    \u003ca href='https://scholar.google.com/citations?user=Hv-vj2sAAAAJ\u0026hl=en' target='_blank'\u003e\u003cstrong\u003eChangqian Yu\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n\u003c/div\u003e\n\n\u003cdiv align='center'\u003e\n  \u003ca href='https://scholar.google.com.au/citations?user=ePIeVuUAAAAJ\u0026hl=en' target='_blank'\u003e\u003cstrong\u003eMingyuan Fan\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n  \u003ca href='https://scholar.google.com/citations?user=HukWSw4AAAAJ\u0026hl=en' target='_blank'\u003e\u003cstrong\u003eGuibin Chen\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n  \u003ca href='https://scholar.google.com.tw/citations?user=RvAuMk0AAAAJ\u0026hl=zh-CN' target='_blank'\u003e\u003cstrong\u003eXiang Wen\u003c/strong\u003e\u003c/a\u003e\u0026emsp;\n\u003c/div\u003e\n\n\u003cdiv align='center'\u003e\n    \u003csmall\u003eSkywork AI \u003c/small\u003e\n\u003c/div\u003e\n\n\u003cbr\u003e\n\n\u003cdiv align=\"center\"\u003e\n  \u003c!-- \u003ca href='LICENSE'\u003e\u003cimg src='https://img.shields.io/badge/license-MIT-yellow'\u003e\u003c/a\u003e --\u003e\n  \u003ca href='https://arxiv.org/abs/2502.10841'\u003e\u003cimg src='https://img.shields.io/badge/arXiv-SkyReels A1-red'\u003e\u003c/a\u003e\n  \u003ca href='https://skyworkai.github.io/skyreels-a1.github.io/'\u003e\u003cimg src='https://img.shields.io/badge/Project-SkyReels A1-green'\u003e\u003c/a\u003e\n  \u003ca href='https://huggingface.co/Skywork/SkyReels-A1'\u003e\u003cimg src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Models-blue'\u003e\u003c/a\u003e\n  \u003ca href='https://www.skyreels.ai/home'\u003e\u003cimg src='https://img.shields.io/badge/Playground-Spaces-yellow'\u003e\u003c/a\u003e\n  \u003cbr\u003e\n\u003c/div\u003e\n\u003cbr\u003e\n\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"./assets/demo.gif\" alt=\"showcase\"\u003e\n  \u003cbr\u003e\n  🔥 For more results, visit our \u003ca href=\"https://skyworkai.github.io/skyreels-a1.github.io/\"\u003e\u003cstrong\u003ehomepage\u003c/strong\u003e\u003c/a\u003e 🔥\n\u003c/p\u003e\n\n\nThis repo, named **SkyReels-A1**, contains the official PyTorch implementation of our paper [SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers](https://arxiv.org).\n\n\n## 🔥🔥🔥 News!!\n* Feb 18, 2025: 👋 We release the inference code and model weights of SkyReels-A1. [Download](https://huggingface.co/Skywork/SkyReels-A1)\n* Feb 18, 2025: 🎉 We have made our technical report available as open source. [Read](https://skyworkai.github.io/skyreels-a1.github.io/report.pdf)\n\n\n## Getting Started 🏁 \n\n### 1. Clone the code and prepare the environment 🛠️\nFirst git clone the repository with code: \n```bash\ngit clone https://github.com/SkyworkAI/SkyReels-A1.git\ncd SkyReels-A1\n\n# create env using conda\nconda create -n skyreels-a1 python=3.10\nconda activate skyreels-a1\n```\nThen, install the remaining dependencies:\n```bash\npip install -r requirements.txt\n```\n\n\n### 2. Download pretrained weights 📥\nYou can download the pretrained weights is from HuggingFace:\n```bash\n# !pip install -U \"huggingface_hub[cli]\"\nhuggingface-cli download SkyReels-A1 --local-dir local_path --exclude \"*.git*\" \"README.md\" \"docs\"\n```\n\nThe FLAME, mediapipe, and smirk models are located in the SkyReels-A1/extra_models folder.\n\nThe directory structure of our SkyReels-A1 code is formulated as: \n```text\npretrained_weights\n├── FLAME\n├── SkyReels-A1-5B\n│   ├── pose_guider\n│   ├── scheduler\n│   ├── tokenizer\n│   ├── siglip-so400m-patch14-384\n│   ├── transformer\n│   ├── vae\n│   └── text_encoder\n├── mediapipe\n└── smirk\n\n```\n\n\n### 3. Inference 🚀\nYou can simply run the inference scripts as: \n```bash\npython inference.py\n```\n\nIf the script runs successfully, you will get an output mp4 file. This file includes the following results: driving video, input image or video, and generated result.\n\n\n## Gradio Interface 🤗\n\nWe provide a [Gradio](https://huggingface.co/docs/hub/spaces-sdks-gradio) interface for a better experience, just run by:\n\n```bash\npython app.py\n```\n\nThe graphical interactive interface is shown as below: \n\n![gradio](https://github.com/user-attachments/assets/ed56f08c-f31c-4fbe-ac1d-c4d4e87a8719)\n\n\n## Metric Evaluation 👓\n\nWe also provide all scripts for automatically calculating the metrics, including SimFace, FID, and L1 distance between expression and motion, reported in the paper.  \n\nAll codes can be found in the ```eval``` folder. After setting the video result path, run the following commands in sequence: \n\n```bash\npython arc_score.py\npython expression_score.py\npython pose_score.py\n```\n\n\n## Acknowledgements 💐\nWe would like to thank the contributors of [CogvideoX](https://github.com/THUDM/CogVideo) and [finetrainers](https://github.com/a-r-r-o-w/finetrainers) repositories, for their open research and contributions. \n\n## Citation 💖\nIf you find SkyReels-A1 useful for your research, welcome to 🌟 this repo and cite our work using the following BibTeX:\n```bibtex\n@misc{qiu2025skyreelsa1expressiveportraitanimation,\n      title={SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers}, \n      author={Di Qiu and Zhengcong Fei and Rui Wang and Jialin Bai and Changqian Yu and Mingyuan Fan and Guibin Chen and Xiang Wen},\n      year={2025},\n      eprint={2502.10841},\n      archivePrefix={arXiv},\n      primaryClass={cs.CV},\n      url={https://arxiv.org/abs/2502.10841}, \n}\n```\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSkyworkAI%2FSkyReels-A1","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FSkyworkAI%2FSkyReels-A1","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSkyworkAI%2FSkyReels-A1/lists"}