Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/josephkj/awesome-layout-generators

An awesome list of layout generation papers
https://github.com/josephkj/awesome-layout-generators

List: awesome-layout-generators

Last synced: 4 days ago
JSON representation

An awesome list of layout generation papers

Awesome Lists containing this project

README 

        
# Awesome-Layout-Generators





  




Layout Generation refers to the multi-modal problem of generating layouts of a flyer, magazine, a UI interface or even a natural image.



This is a niche area, which is increasingly receiving attention from the community. This awesome-listing is an attempt to bring together works in this space. This list is not complete and looking for your PRs to improve it. Thanks!



## Preprints

- LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generation [[Paper]](https://arxiv.org/abs/2407.12356) [[Code]](https://github.com/mayu-ot/ltsim)

- CGB-DM: Content and Graphic Balance Layout Generation with Transformer-based Diffusion Model [[Paper]](https://arxiv.org/abs/2407.15233)

- PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM [[Paper]](https://arxiv.org/abs/2406.02884v1) [[Code]](https://github.com/posterllava/PosterLLaVA)

- Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models [[Paper]](https://arxiv.org/abs/2404.15271)

- Graphic Design with Large Multimodal Model [[Paper]](https://arxiv.org/abs/2404.14368)

- Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis [[Paper]](https://arxiv.org/abs/2311.17126)

- COLE: A Hierarchical Generation Framework for Graphic Design [[Paper]](https://arxiv.org/abs/2311.16974)

- UniLayout: Taming Unified Sequence-to-Sequence Transformers for Graphic Layout Generation [[Paper]](https://arxiv.org/abs/2208.08037)



## 2024

- LayoutFlow: Flow Matching for Layout Generation (**ECCV** 2024) [[Paper]](https://arxiv.org/abs/2403.18187) [[Code]](https://github.com/JulianGuerreiro/LayoutFlow)

- PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation (**ECCV** 2024) [[Paper]](https://arxiv.org/abs/2404.00995) [[Code]](https://github.com/jaepoong/PosterLlama)

- Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model (**ECCV** 2024) [[Paper]](https://arxiv.org/abs/2409.16689) [[Code]](https://github.com/line/Layout-Corrector)

- Dolfin: Diffusion Layout Transformers without Autoencoder (**ECCV** 2024) [[Paper]](https://arxiv.org/abs/2310.16305)

- LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer (**ECCV** 2024) [[Paper]](https://arxiv.org/abs/2212.09877) [[Code]](https://github.com/salesforce/LayoutDETR)

- SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters (**BMVC** 2024) [[Paper]](https://arxiv.org/abs/2407.19787) [[Dataset]](https://huggingface.co/datasets/omron-sinicx/scipostlayout_v2) [[Code]](https://github.com/omron-sinicx/scipostlayout)

- OpenCOLE: Towards Reproducible Automatic Graphic Design Generation (**CVPRW** 2024) [[Paper]](https://arxiv.org/abs/2406.08232) [[Code]](https://github.com/CyberAgentAILab/OpenCOLE)

- Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation (**CVPR** 2024) [[Paper]](https://arxiv.org/abs/2311.13602) [[Code]](https://github.com/CyberAgentAILab/RALF)

- Desigen: A Pipeline for Controllable Design Template Generation (**CVPR** 2024) [[Paper]](https://arxiv.org/abs/2403.09093) [[Code]](https://github.com/whaohan/desigen)

- Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation (**CVPR** 2024) [[Paper]](https://aminshabani.github.io/visual_layout_composer/pdfs/visual_layout_composer.pdf)

- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models (**ICLR** 2024) [[Paper]](https://openreview.net/forum?id=qCUWVT0Ayy) [[Code]](https://github.com/ProjectNUWA/LayoutNUWA)

- Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints (**ICLR** 2024) [[Paper]](https://openreview.net/forum?id=kJ0qp9Xdsh)

- Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator (**AAAI** 2024) [[Paper]](https://arxiv.org/abs/2401.16375) [[Code]](https://github.com/ffffatgoose/SpotError)



## 2023

- LayoutGPT: Compositional Visual Planning and Generation with Large Language Models (**NeurIPS** 2023) [[Paper]](https://arxiv.org/abs/2305.15393) [[Code]](https://github.com/weixi-feng/LayoutGPT)

- LayoutPrompter: Awaken the Design Ability of Large Language Models (**NeurIPS** 2023) [[Paper]](https://arxiv.org/abs/2311.06495) [[Code]](https://github.com/microsoft/LayoutGeneration)

- A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions (**ICCV** 2023) [[Paper]](https://arxiv.org/abs/2308.12700) [[Code]](https://github.com/microsoft/LayoutGeneration)

- LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models (**ICCV** 2023) [[Paper]](https://arxiv.org/abs/2303.11589) [[Code]](https://github.com/microsoft/LayoutGeneration)

- DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer (**ICCV** 2023) [[Project page]](https://wix-incubator.github.io/DLT/) [[Paper]](https://arxiv.org/abs/2303.03755) [[Code]](https://github.com/wix-incubator/DLT)

- Diffusion-based Document Layout Generation (**ICDAR** 2023) [[Paper]](https://arxiv.org/abs/2303.10787)

- Unifying Layout Generation with a Decoupled Diffusion Model (**CVPR** 2023) [[Paper]](https://arxiv.org/abs/2303.05049)

- LayoutDM: Discrete Diffusion Model for Controllable Layout Generation (**CVPR** 2023) [[Paper]](https://arxiv.org/abs/2303.08137) [[Code]](https://github.com/CyberAgentAILab/layout-dm)

- LayoutDM: Transformer-based Diffusion Model for Layout Generation (**CVPR** 2023) [[Paper]](https://arxiv.org/abs/2305.02567)

- PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layout (**CVPR** 2023)  [[Paper]](https://openaccess.thecvf.com/content/CVPR2023/papers/Hsu_PosterLayout_A_New_Benchmark_and_Approach_for_Content-Aware_Visual-Textual_Presentation_CVPR_2023_paper.pdf) [[Code]](https://github.com/PKU-ICST-MIPL/PosterLayout-CVPR2023)

- Towards Flexible Multi-modal Document Models (**CVPR** 2023) [[Paper]](https://openaccess.thecvf.com/content/CVPR2023/papers/Inoue_Towards_Flexible_Multi-Modal_Document_Models_CVPR_2023_paper.pdf) [[Code]](https://github.com/CyberAgentAILab/flex-dm)

- Machine Learning Model to Evaluate the Appropriateness of Layout for Automatic Generation of Graphic Design Works (**IMCOM** 2023) [[Paper]](https://ieeexplore.ieee.org/abstract/document/10035646)

- DensityLayout: Density-conditioned Layout GAN for Visual-textual Presentation Designs (**ICIG** 2023) [[Paper]](https://link.springer.com/chapter/10.1007/978-3-031-46308-2_16)



## 2022

- BLT: Bidirectional Layout Transformer for Controllable Layout Generation (**ECCV** 2022) [[Paper]](https://arxiv.org/abs/2112.05112) [[Code]](https://github.com/google-research/google-research/tree/master/layout-blt)

- Coarse-to-Fine Generative Modeling for Graphic Layouts (**AAAI** 2022) [[Paper]](https://www.microsoft.com/en-us/research/uploads/prod/2022/01/Coarse-to-Fine-Generative-Modeling-for-Graphic-Layouts.pdf)

- Geometry Aligned Variational Transformer for Image-conditioned Layout Generation (**MM** 2022) [[Paper]](https://arxiv.org/abs/2209.00852)

- Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs (**IJCAI** 2022) [[Paper]](https://arxiv.org/abs/2205.00303)



## 2021

- Variational Transformer Networks for Layout Generation (**CVPR** 2021) [[Paper]](https://arxiv.org/abs/2104.02416)

- LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity (**CVPR** 2021) [[Paper]](https://openaccess.thecvf.com/content/CVPR2021/html/Yang_LayoutTransformer_Scene_Layout_Generation_With_Conceptual_and_Spatial_Diversity_CVPR_2021_paper.html) [[Code]](https://github.com/davidhalladay/LayoutTransformer)

- Constrained Graphic Layout Generation via Latent Optimization (**MM** 2021) [[Paper]](https://arxiv.org/abs/2108.00871) [[Code]](https://github.com/ktrk115/const_layout)

- LayoutTransformer: Layout Generation and Completion with Self-attention (**ICCV** 2021) [[Paper]](https://arxiv.org/abs/2006.14615) [[Code]](https://github.com/kampta/DeepLayout)

- CanvasVAE: Learning to Generate Vector Graphic Documents (**ICCV** 2021) [[Paper]](https://arxiv.org/abs/2108.01249) [[Code]](https://github.com/CyberAgentAILab/canvas-vae)

- RUITE: Refining UI Layout Aesthetics Using Transformer Encoder (**IUI** 2021) [[Paper]](https://dl.acm.org/doi/abs/10.1145/3397482.3450716) [[Code]](https://github.com/vinothpandian/RUITE)



## 2020

- Neural Design Network: Graphic Layout Generation with Constraints (**ECCV** 2020) [[Paper]](https://arxiv.org/abs/1912.09421)

- Attribute-conditioned Layout GAN for Automatic Graphic Design (**T-VCG** 2020) [[Paper]](https://arxiv.org/abs/2009.05284)

- READ: Recursive Autoencoders for Document Layout Generation (**CVPRW** 2020) [[Paper]](https://arxiv.org/abs/1909.00302)



## 2019

- LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks (**ICLR** 2019, **T-PAMI** 2021) [[ICLR paper]](https://openreview.net/pdf?id=HJxB5sRcFQ) [[T-PAMI Paper]](https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8948239)

- LayoutVAE: Stochastic Scene Layout Generation From a Label Set (**ICCV** 2019) [[Paper]](https://arxiv.org/abs/1907.10719)



## 2015

- Designscape: Design with interactive layout suggestions (**CHI** 2015) [[Paper]](https://dl.acm.org/doi/abs/10.1145/2702123.2702149?casa_token=jO3SW90ttW0AAAAA%3Ay1qhSVwfEtUP4IxjRCv_0Xv9PVvyyT9mivkMJX4pcyFf8qRh5qF-9-hgOZSkxO3s230kjj8BI7TUgMk)



## 2014

- Learning Layouts for Single-Page Graphic Designs (**TVCG** 2014) [[Paper]](http://www.dgp.toronto.edu/~donovan/layout/designLayout.pdf)