https://github.com/aim-uofa/MovieDreamer

https://github.com/aim-uofa/MovieDreamer

Last synced: 5 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/aim-uofa/MovieDreamer
• Owner: aim-uofa
• Created: 2024-07-20T10:27:12.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-08-10T08:54:31.000Z (3 months ago)
• Last Synced: 2024-08-11T05:36:44.765Z (3 months ago)
• Size: 55.8 MB
• Stars: 181
• Watchers: 19
• Forks: 4
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-diffusion-categorized - [Code

README

        


  







  

## MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequences




  📖 Project Page |

  📄 Paper Link |

  🤗 Huggingface Paper Link |

  📹 Demo





> MovieDreamer aims to provide a solution for long content generation. Our method is capable of generating both long story and long video with multiple characters well-preserved!



    



## 📣 News

- [7/20/2024] Paper released!

## 😲 Results

Please refer to our [homepage](https://aim-uofa.github.io/MovieDreamer/) for more thrilling results!

## 🛠️ Setup

- Comming Soon...

## 🚩 Plan

- [x] Story Results and Video Results.

- [x] Paper Released.

- [ ] Source Code and Pretrained Weights of Diffusion AutoEncoder.

- [ ] Source Code and Pretrained Weights of Autoregressive Model.

- [ ] Source code of Video Generation.

- [ ] Source code of Data Pre-processing.

- [ ] Source code of Training.

## 🎫 License

For academic use, this project is licensed under [the 2-clause BSD License](https://opensource.org/license/bsd-2-clause). 

For commercial use, please contact [Chunhua Shen](mailto:[email protected]).

## 🖊️ Citation

```

@misc{zhao2024moviedreamerhierarchicalgenerationcoherent,

      title={MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence}, 

      author={Canyu Zhao and Mingyu Liu and Wen Wang and Jianlong Yuan and Hao Chen and Bo Zhang and Chunhua Shen},

      year={2024},

      eprint={2407.16655},

      archivePrefix={arXiv},

      primaryClass={cs.CV},

      url={https://arxiv.org/abs/2407.16655}, 

}

```