paper-with-me

홈 › Papers

TextAtlas5M: A Large-scale Dataset for Dense Text Image Generation

2025-02-11 · Alex Jinpeng Wang, Dongxing Mao, Jiawei Zhang, Weiming Han, Zhuobai Dong, Linjie Li, Yiqi Lin, Zhengyuan Yang, Libo Qin, Fuwei Zhang, Lijuan Wang, Min Li

Text-conditioned image generation has gained significant attention in recent years and are processing increasingly longer and comprehensive text prompt. In everyday life, dense and intricate text appears in contexts like advertisements, infographics, and signage, where the integration of both text and visuals is essential for conveying complex information. However, despite these advances, the generation of images containing long-form text remains a persistent challenge, largely due to the limitations of existing datasets, which often focus on shorter and simpler text. To address this gap, we introduce TextAtlas5M, a novel dataset specifically designed to evaluate long-text rendering in text-conditioned image generation. Our dataset consists of 5 million long-text generated and collected images across diverse data types, enabling comprehensive evaluation of large-scale generative models on long-text image generation. We further curate 3000 human-improved test set TextAtlasEval across 3 data domains, establishing one of the most extensive benchmarks for text-conditioned generation. Evaluations suggest that the TextAtlasEval benchmarks present significant challenges even for the most advanced proprietary models (e.g. GPT4o with DallE-3), while their open-source counterparts show an even larger performance gap. These evidences position TextAtlas5M as a valuable dataset for training and evaluating future-generation text-conditioned image generation models.

📄 PDF Abstract BibTeX arXiv:2502.07870

Code (1)

CSU-JPG/TextAtlas 공식 구현 pytorch

Tasks

Image Generation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음

Similar Papers 제목 키워드 기반

Residual Decoder Adapter: ID-Preserving Tokenizer Adaption for Autoregressive Text Rendering

2026-06-01 · Dongxing Mao, Jinpeng Wang, Jiahao Tang, Kevin Qinghong Lin 외 arxiv

Visual Autoregressive (AR) models generate images by predicting discrete tokens that are decoded by a visual tokenizer. Despite demonstrating strong overall image generation ability, they still underperform on text rende…

Image Generation

A Unified Image-Dense Annotation Generation Model for Underwater Scenes

2025-03-27 · CVPR 2025 1 · Hongkai Lin, Dingkang Liang, Zhenghao Qi, Xiang Bai

Underwater dense prediction, especially depth estimation and semantic segmentation, is crucial for gaining a comprehensive understanding of underwater scenes. Nevertheless, high-quality and large-scale underwater dataset…

Depth EstimationPredictionSemantic Segmentation

BLIP3-KALE: Knowledge Augmented Large-Scale Dense Captions

2024-11-12 · Anas Awadalla, Le Xue, Manli Shu, An Yan 외

We introduce BLIP3-KALE, a dataset of 218 million image-text pairs that bridges the gap between descriptive synthetic captions and factual web-scale alt-text. KALE augments synthetic dense image captions with web-scale a…

DescriptiveImage Captioning

GenCAMO: Scene-Graph Contextual Decoupling for Environment-aware and Mask-free Camouflage Image-Dense Annotation Generation

2026-01-03 · Chenglizhao Chen, Shaojiang Yuan, Xiaoxue Lu, Mengke Song 외 arxiv

Conceal dense prediction (CDP), especially RGB-D camouflage object detection and open-vocabulary camouflage object segmentation, plays a crucial role in advancing the understanding and reasoning of complex camouflage sce…

Object SegmentationObject Detection

Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner

2023-05-19 · Zikang Liu, Sihan Chen, Longteng Guo, Handong Li 외

Large pre-trained multimodal models have demonstrated significant success in a range of downstream tasks, including image captioning, image-text retrieval, visual question answering (VQA), etc. However, many of these met…

Dense CaptioningImage CaptioningImage-text RetrievalQuestion Answering+4