paper-with-me

Papers

LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models

2023-03-21 · ICCV 2023 1 · Junyi Zhang, Jiaqi Guo, Shizhao Sun, Jian-Guang Lou, Dongmei Zhang

Creating graphic layouts is a fundamental step in graphic designs. In this work, we present a novel generative model named LayoutDiffusion for automatic layout generation. As layout is typically represented as a sequence of discrete tokens, LayoutDiffusion models layout generation as a discrete denoising diffusion process. It learns to reverse a mild forward process, in which layouts become increasingly chaotic with the growth of forward steps and layouts in the neighboring steps do not differ too much. Designing such a mild forward process is however very challenging as layout has both categorical attributes and ordinal attributes. To tackle the challenge, we summarize three critical factors for achieving a mild forward process for the layout, i.e., legality, coordinate proximity and type disruption. Based on the factors, we propose a block-wise transition matrix coupled with a piece-wise linear noise schedule. Experiments on RICO and PubLayNet datasets show that LayoutDiffusion outperforms state-of-the-art approaches significantly. Moreover, it enables two conditional layout generation tasks in a plug-and-play manner without re-training and achieves better performance than existing methods.

📄 PDF Abstract BibTeX arXiv:2303.11589

Code (1)

microsoft/layoutgeneration 공식 구현 jax

Tasks

Layout DesignLayout Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation

2023-03-30 · CVPR 2023 1 · Guangcong Zheng, Xianpan Zhou, XueWei Li, Zhongang Qi 외

Recently, diffusion models have achieved great success in image synthesis. However, when it comes to the layout-to-image generation where an image often has a complex scene of multiple objects, how to make strong control…

Image GenerationLayout-to-Image GenerationObject

DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer

2023-03-07 · ICCV 2023 1 · Elad Levi, Eli Brosh, Mykola Mykhailych, Meir Perez

Generating visual layouts is an essential ingredient of graphic design. The ability to condition layout generation on a partial subset of component attributes is critical to real-world applications that involve user inte…

Layout Generation

Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints

2024-02-07 · Jian Chen, Ruiyi Zhang, Yufan Zhou, Rajiv Jain 외

Controllable layout generation refers to the process of creating a plausible visual arrangement of elements within a graphic design (e.g., document and web designs) with constraints representing design intentions. Althou…

Layout DesignLayout Generation

LayoutDM: Discrete Diffusion Model for Controllable Layout Generation

2023-03-14 · CVPR 2023 1 · Naoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani 외

Controllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to solve a broad range o…

Layout GenerationmodelPosition

DogLayout: Denoising Diffusion GAN for Discrete and Continuous Layout Generation

2024-11-30 · Zhaoxing Gan, Guangnan Ye

Layout Generation aims to synthesize plausible arrangements from given elements. Currently, the predominant methods in layout generation are Generative Adversarial Networks (GANs) and diffusion models, each presenting it…

DenoisingLayout Generation