https://github.com/yuanze-lin/illumicraft

[NeurIPS 2025] The official code for "IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation"
https://github.com/yuanze-lin/illumicraft

aigc controllable-ai controllable-generation diffusion-models diffusion-transformer video-generation

Last synced: 4 months ago
JSON representation

[NeurIPS 2025] The official code for "IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation"

• Host: GitHub
• URL: https://github.com/yuanze-lin/illumicraft
• Owner: yuanze-lin
• Created: 2025-05-30T08:54:54.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-06-05T14:14:38.000Z (about 1 year ago)
• Last Synced: 2025-10-28T10:06:07.247Z (8 months ago)
• Topics: aigc, controllable-ai, controllable-generation, diffusion-models, diffusion-transformer, video-generation
• Homepage: https://yuanze-lin.me/IllumiCraft_page/
• Size: 43 MB
• Stars: 20
• Watchers: 6
• Forks: 1
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          


# IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation  


Official implementation of "IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation" 

[![PDF](https://img.shields.io/badge/PDF-Download-orange?style=flat-square&logo=adobeacrobatreader&logoColor=white)](https://arxiv.org/pdf/2506.03150)

[![arXiv](https://img.shields.io/badge/arXiv-2506.03150-b31b1b.svg)](https://arxiv.org/abs/2506.03150)

[![Project Page](https://img.shields.io/badge/Project%20Page-Visit%20Now-00d45c?style=flat-square&logo=googlechrome&logoColor=white)](https://yuanze-lin.me/IllumiCraft_page/)

[![YouTube Video](https://img.shields.io/badge/YouTube%20Video-FF0000?style=flat-square&logo=youtube&logoColor=white)](https://youtu.be/qAV58sADEzo)

[Yuanze Lin](https://yuanze-lin.me/), [Yi-Wen Chen](https://wenz116.github.io/), [Yi-Hsuan Tsai](https://sites.google.com/site/yihsuantsai/), [Ronald Clark](https://www.ron-clark.com/), [Ming-Hsuan Yang](https://faculty.ucmerced.edu/mhyang/)

## :mega:  News

- [ ] Release the training code.

- [ ] Release IllumiCraft dataset.

- [ ] Release the model and the inference code.

- [x] Set up the project page.

  

## :low_brightness: Method 

![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/assets/framework.png)

## :snowboarder: Results



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/14.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/2.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/1.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/3.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/4.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/5.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/7.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/8.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/10.gif)



![image](https://github.com/yuanze-lin/IllumiCraft/blob/main/examples/11.gif)