https://github.com/rese1f/citygen

🏙️🌆🌃 Try Infinite and Controllable 3D City Layout Generation!
https://github.com/rese1f/citygen

aigc cityscapes diffusion-models

Last synced: 2 months ago
JSON representation

🏙️🌆🌃 Try Infinite and Controllable 3D City Layout Generation!

• Host: GitHub
• URL: https://github.com/rese1f/citygen
• Owner: rese1f
• License: mit
• Created: 2023-08-05T16:44:13.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-12-10T21:47:20.000Z (almost 2 years ago)
• Last Synced: 2025-02-25T05:14:51.217Z (8 months ago)
• Topics: aigc, cityscapes, diffusion-models
• Homepage: https://rese1f.github.io/CityGen/
• Size: 21.8 MB
• Stars: 38
• Watchers: 7
• Forks: 2
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          


# CityGen

[![](http://img.shields.io/badge/cs.CV-arXiv%3A2312.01508-B31B1B.svg)](https://arxiv.org/abs/2312.01508)

> **CityGen: Infinite and Controllable 3D City Layout Generation**  

> Jie Deng*, Wenhao Chai*, Jianshu Guo*, Qixuan Huang, Wenhao Hu, Jenq-Neng Hwang, Gaoang Wang✉️   

> _arXiv 2023_  

CityGen is a novel framework for infinite, controllable and diverse 3D city layout Generation. We propose an auto-regressive out-painting pipeline to extend the local layout to an infinite city layout. Moreover, we utilize a multi-scale diffusion model to generate controllable semantic field.

## :fire: News

* **[TBD]** : We will soon release our code, model weight, and dataset.

* **[2023.12.3]** :page_with_curl: We release the [paper](https://arxiv.org/abs/2312.01508).

## 💡 Overview

In the initial step, we sample a local block from noise and extend it infinitely through the auto-regressive outpainting process. Subsequently, we iteratively refine the global semantic field to achieve a more nuanced and polished global field. Following the refinement, height values are assigned to each class. After that, we integrate the semantic field with the height field to synthesize the 3D layout. Finally, by employing an image-to-image approach, we can effectively synthesize diverse city scenes.

![](assets/overview.png)

## 📣 Case Study

### User control

![](assets/user_control.png)

### 3D layout

![](assets/3d_layout.png)

## ✏️ Citation

If you find CityGen useful for your your research and applications, please cite using this BibTeX:

```bibtex

@article{deng2023citygen,

  title={CityGen: Infinite and Controllable 3D City Layout Generation},

  author={Deng, Jie and Chai, Wenhao and Guo, Jianshu and Huang, Qixuan and Hu, Wenhao and Hwang, Jenq-Neng and Wang, Gaoang},

  journal={arXiv preprint arXiv:2312.01508},

  year={2023}

}

```