paper-with-me

홈 › Papers

BLT: Bidirectional Layout Transformer for Controllable Layout Generation

2021-12-09 · Xiang Kong, Lu Jiang, Huiwen Chang, Han Zhang, Yuan Hao, Haifeng Gong, Irfan Essa

Creating visual layouts is a critical step in graphic design. Automatic generation of such layouts is essential for scalable and diverse visual designs. To advance conditional layout generation, we introduce BLT, a bidirectional layout transformer. BLT differs from previous work on transformers in adopting non-autoregressive transformers. In training, BLT learns to predict the masked attributes by attending to surrounding attributes in two directions. During inference, BLT first generates a draft layout from the input and then iteratively refines it into a high-quality layout by masking out low-confident attributes. The masks generated in both training and inference are controlled by a new hierarchical sampling policy. We verify the proposed model on six benchmarks of diverse design tasks. Experimental results demonstrate two benefits compared to the state-of-the-art layout transformer models. First, our model empowers layout transformers to fulfill controllable layout generation. Second, it achieves up to 10x speedup in generating a layout at inference time than the layout transformer baseline. Code is released at https://shawnkx.github.io/blt.

📄 PDF Abstract BibTeX arXiv:2112.05112

Code (1)

ginofft/flax-BLT jax

Tasks

Layout Generation

Similar Papers 제목 키워드 기반

Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation

2023-11-22 · CVPR 2024 1 · Daichi Horita, Naoto Inoue, Kotaro Kikuchi, Kota Yamaguchi 외

Content-aware graphic layout generation aims to automatically arrange visual elements along with a given content, such as an e-commerce product image. In this paper, we argue that the current layout generation approaches…

Layout GenerationRetrieval

CityGen: Infinite and Controllable 3D City Layout Generation

2023-12-03 · Jie Deng, Wenhao Chai, Jianshu Guo, Qixuan Huang 외

City layout generation has recently gained significant attention. The goal of this task is to automatically generate the layout of a city scene, including elements such as roads, buildings, vegetation, as well as other u…

DiversityLayout Generation

LayoutDM: Discrete Diffusion Model for Controllable Layout Generation

2023-03-14 · CVPR 2023 1 · Naoto Inoue, Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani 외

Controllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to solve a broad range o…

Layout GenerationmodelPosition

CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generation

2024-12-05 · HUI ZHANG, Dexiang Hong, Tingwei Gao, Yitong Wang 외

Diffusion models have been recognized for their ability to generate images that are not only visually appealing but also of high artistic quality. As a result, Layout-to-Image (L2I) generation has been proposed to levera…

Image GenerationLayout GenerationLayout-to-Image Generation

LTOS: Layout-controllable Text-Object Synthesis via Adaptive Cross-attention Fusions

2024-04-21 · Xiaoran Zhao, Tianhao Wu, Yu Lai, Zhiliang Tian 외

Controllable text-to-image generation synthesizes visual text and objects in images with certain conditions, which are frequently applied to emoji and poster generation. Visual text rendering and layout-to-image generati…

Image GenerationLayout-to-Image GenerationObjectText to Image Generation+1