paper-with-me

Papers

TextGround4M: A Prompt-Aligned Dataset for Layout-Aware Text Rendering

2026-04-27 · Dongxing Mao, Yilin Wang, Linjie Li, Zhengyuan Yang, Alex Jinpeng Wang arxiv

Despite recent advances in text-to-image generation, models still struggle to accurately render prompt-specified text with correct spatial layout -- especially in multi-span, structured settings. This challenge is driven not only by the lack of datasets that align prompts with the exact text and layout expected in the image, but also by the absence of effective metrics for evaluating layout quality. To address these issues, we introduce TextGround4M, a large-scale dataset of over 4 million prompt-image pairs, each annotated with span-level text grounded in the prompt and corresponding bounding boxes. This enables fine-grained supervision for layout-aware, prompt-grounded text rendering. Building on this, we propose a lightweight training strategy for autoregressive T2I models that appends layout-aware span tokens during training, without altering model architecture or inference behavior. We further construct a benchmark with stratified layout complexity to evaluate both open-source and proprietary models in a zero-shot setting. In addition, we introduce two layout-aware metrics to address the long-standing lack of spatial evaluation in text rendering. Our results show that models trained on TextGround4M outperform strong baselines in text fidelity, spatial accuracy, and prompt consistency, highlighting the importance of fine-grained layout supervision for grounded T2I generation.

📄 PDF Abstract BibTeX arXiv:2604.24459

Code (0)

등록된 구현이 없습니다.

Tasks

Text-to-Image Generation

Similar Papers 제목 키워드 기반

PromptDLA: A Domain-aware Prompt Document Layout Analysis Framework with Descriptive Knowledge as a Cue

2026-03-10 · Zirui Zhang, Yaping Zhang, Lu Xiang, Yang Zhao 외 arxiv

Document Layout Analysis (DLA) is crucial for document artificial intelligence and has recently received increasing attention, resulting in an influx of large-scale public DLA datasets. Existing work often combines data …

Document Layout Analysis

ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation

2026-06-10 · Junlin Hao, Haoshuai Fu, Xibin Song, Wei Li 외 arxiv

Part-aware 3D generation aims to synthesize structured objects with semantically meaningful components, yet often suffers from structural ambiguity due to identity-layout entanglement. Existing methods either infer part …

3D Generation

Quality-Driven and Diversity-Aware Sample Expansion for Robust Marine Obstacle Segmentation

2025-12-16 · Miaohua Zhang, Mohammad Ali Armin, Xuesong Li, Sisi Liang 외 arxiv

Marine obstacle detection demands robust segmentation under challenging conditions, such as sun glitter, fog, and rapidly changing wave patterns. These factors degrade image quality, while the scarcity and structural rep…

LEARN: A Story-Driven Layout-to-Image Generation Framework for STEM Instruction

2025-08-15 · Maoquan Zhang, Bisser Raytchev, Xiujuan Sun arxiv

LEARN is a layout-aware diffusion framework designed to generate pedagogically aligned illustrations for STEM education. It leverages a curated BookCover dataset that provides narrative layouts and structured visual cues…

Layout-to-Image GenerationKnowledge Graphs

Stable Diffusion Exposed: Gender Bias from Prompt to Image

2023-12-05 · Yankun Wu, Yuta Nakashima, Noa Garcia

Several studies have raised awareness about social biases in image generative models, demonstrating their predisposition towards stereotypes and imbalances. This paper contributes to this growing body of research by intr…

Image Generation