paper-with-me

Papers

VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correction

2024-12-05 · Jiahao Zhang, Ryota Yoshihashi, Shunsuke Kitada, Atsuki Osanai, Yuta Nakashima

Large language models (LLMs) have proven effective for layout generation due to their ability to produce structure-description languages, such as HTML or JSON, even without access to visual information. Recently, LLM providers have evolved these models into large vision-language models (LVLM), which shows prominent multi-modal understanding capabilities. Then, how can we leverage this multi-modal power for layout generation? To answer this, we propose Visual-Aware Self-Correction LAyout GeneRation (VASCAR) for LVLM-based content-aware layout generation. In our method, LVLMs iteratively refine their outputs with reference to rendered layout images, which are visualized as colored bounding boxes on poster backgrounds. In experiments, we demonstrate that our method combined with the Gemini. Without any additional training, VASCAR achieves state-of-the-art (SOTA) layout generation quality outperforming both existing layout-specific generative models and other LLM-based methods.

📄 PDF Abstract BibTeX arXiv:2412.04237

Code (0)

등록된 구현이 없습니다.

Tasks

Layout Generation

Similar Papers 제목 키워드 기반

Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation

2023-11-22 · CVPR 2024 1 · Daichi Horita, Naoto Inoue, Kotaro Kikuchi, Kota Yamaguchi 외

Content-aware graphic layout generation aims to automatically arrange visual elements along with a given content, such as an e-commerce product image. In this paper, we argue that the current layout generation approaches…

Layout GenerationRetrieval

PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation

2024-04-01 · Jaejung Seol, Seojun Kim, Jaejun Yoo

Visual layout plays a critical role in graphic design fields such as advertising, posters, and web UI design. The recent trend towards content-aware layout generation through generative models has shown promise, yet it o…

Layout DesignLayout Generation

LayoutDiT: Exploring Content-Graphic Balance in Layout Generation with Diffusion Transformer

2024-07-21 · Yu Li, Yifan Chen, Gongye Liu, Fei Yin 외

Layout generation is a foundation task of graphic design, which requires the integration of visual aesthetics and harmonious expression of content delivery. However, existing methods still face challenges in generating p…

BlockingLayout Generation

Relation-Aware Diffusion Model for Controllable Poster Layout Generation

2023-06-15 · Fengheng Li, An Liu, Wei Feng, Honghe Zhu 외

Poster layout is a crucial aspect of poster design. Prior methods primarily focus on the correlation between visual content and graphic elements. However, a pleasant layout should also consider the relationship between v…

Layout GenerationRelation

iPoster: Content-Aware Layout Generation for Interactive Poster Design via Graph-Enhanced Diffusion Models

2026-03-31 · Xudong Zhou, Jinyuan Liang, Qiuyi Guo, Guozheng Li arxiv

We present iPoster, an interactive layout generation framework that empowers users to guide content-aware poster layout design by specifying flexible constraints. iPoster enables users to specify partial intentions withi…