paper-with-me

Papers

LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation

2025-09-21 · Sha Li, Stefano Petrangeli, Yu Shen, Xiang Chen, Naren Ramakrishnan arxiv

While Large Language Models (LLMs) have demonstrated impressive reasoning and planning abilities in textual domains and can effectively follow instructions for complex tasks, their ability to understand and manipulate spatial relationships remains limited. Such capabilities are crucial for content-aware graphic layout design, where the goal is to arrange heterogeneous elements onto a canvas so that final design remains visually balanced and structurally feasible. This problem requires precise coordination of placement, alignment, and structural organization of multiple elements within a constrained visual space. To address this limitation, we introduce LaySPA, a reinforcement learning-based framework that augments LLM-based agents with explicit spatial reasoning capabilities for layout design. LaySPA employs hybrid reward signals that jointly capture geometric constraints, structural fidelity, and visual quality, enabling agents to navigate the canvas, model inter-element relationships, and optimize spatial arrangements. Through group-relative policy optimization, the agent generates content-aware layouts that reflect salient regions, respect spatial constraints, and produces an interpretable reasoning trace explaining placement decisions and a structured layout specification. Experimental results show that LaySPA substantially improves the generation of structurally valid and visually appealing layouts, outperforming larger general-purpose LLMs and achieving performance comparable to state-of-the-art specialized layout models.

📄 PDF Abstract BibTeX arXiv:2509.16891

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningSpatial Reasoning

Similar Papers 제목 키워드 기반

SKE-Layout: Spatial Knowledge Enhanced Layout Generation with LLMs

2025-01-01 · CVPR 2025 1 · Junsheng Wang, Nieqing Cao, Yan Ding, Mengying Xie 외

Generating layouts from textual descriptions by large language models (LLMs) plays a crucial role in precise spatial reasoning-induced domains such as robotic object rearrangement and text-to-image generation. Howeve…

Contrastive LearningImage GenerationLayout GenerationObject Rearrangement+3

Large Language Models Understand Layout

2024-07-08 · Weiming Li, Manni Duan, Dong An, Yan Shao

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processi…

Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)

Scout: Rapid Exploration of Interface Layout Alternatives through High-Level Design Constraints

2020-01-15 · Amanda Swearngin, Chenglong Wang, Alannah Oleson, James Fogarty 외

Although exploring alternatives is fundamental to creating better interface designs, current processes for creating alternatives are generally manual, limiting the alternatives a designer can explore. We present Scout, a…

GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts

2024-11-18 · Junwen He, Yifan Wang, Lijun Wang, Huchuan Lu 외

Text logo design heavily relies on the creativity and expertise of professional designers, in which arranging element layouts is one of the most important procedures. However, few attention has been paid to this specific…

Layout DesignLayout Generation

From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design

2026-02-14 · Sha Li, Stefano Petrangeli, Yu Shen, Xiang Chen arxiv

We introduce LaySPA, a reinforcement learning framework that equips large language models (LLMs) with explicit and interpretable spatial reasoning for content-aware graphic layout design. LaySPA addresses two key challen…

Reinforcement LearningSpatial ReasoningDecision Making