paper-with-me

Papers

DocSynth: A Layout Guided Approach for Controllable Document Image Synthesis

2021-07-06 · Sanket Biswas, Pau Riba, Josep Lladós, Umapada Pal

Despite significant progress on current state-of-the-art image generation models, synthesis of document images containing multiple and complex object layouts is a challenging task. This paper presents a novel approach, called DocSynth, to automatically synthesize document images based on a given layout. In this work, given a spatial layout (bounding boxes with object categories) as a reference by the user, our proposed DocSynth model learns to generate a set of realistic document images consistent with the defined layout. Also, this framework has been adapted to this work as a superior baseline model for creating synthetic document image datasets for augmenting real data during training for document layout analysis tasks. Different sets of learning objectives have been also used to improve the model performance. Quantitatively, we also compare the generated results of our model with real data using standard evaluation metrics. The results highlight that our model can successfully generate realistic and diverse document images with multiple objects. We also present a comprehensive qualitative analysis summary of the different scopes of synthetic image generation tasks. Lastly, to our knowledge this is the first work of its kind.

📄 PDF Abstract BibTeX arXiv:2107.02638

Code (1)

biswassanket/synth_doc_generation 공식 구현 pytorch

Tasks

Document Layout AnalysisImage Generation

Similar Papers 제목 키워드 기반

DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception

2024-10-16 · Zhiyuan Zhao, Hengrui Kang, Bin Wang, Conghui He

Document Layout Analysis is crucial for real-world document understanding systems, but it encounters a challenging trade-off between speed and accuracy: multimodal methods leveraging both text and visual features achieve…

Document Layout Analysisdocument understandingModel Optimization

DocSynthv2: A Practical Autoregressive Modeling for Document Generation

2024-06-12 · Sanket Biswas, Rajiv Jain, Vlad I. Morariu, Jiuxiang Gu 외

While the generation of document layouts has been extensively explored, comprehensive document generation encompassing both layout and content presents a more complex challenge. This paper delves into this advanced domai…

Layout Generation

ConsistCompose: Unified Multimodal Layout Control for Image Composition

2025-11-23 · Xuanke Shi, Boxuan Li, Xiaoyang Han, Zhongang Cai 외 arxiv

Unified multimodal models that couple visual understanding with image generation have advanced rapidly, yet most systems still focus on visual grounding-aligning language with image regions-while their generative counter…

Visual GroundingImage Generation

Document Layout Analysis with Aesthetic-Guided Image Augmentation

2021-11-27 · Tianlong Ma, Xingjiao Wu, Xin Li, Xiangcheng Du 외

Document layout analysis (DLA) plays an important role in information extraction and document understanding. At present, document layout analysis has reached a milestone achievement, however, document layout analysis of …

Document Layout Analysisdocument understandingImage AugmentationSegmentation

Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generation

2023-04-13 · Jaemin Cho, Linjie Li, Zhengyuan Yang, Zhe Gan 외

Spatial control is a core capability in controllable image generation. Advancements in layout-guided image generation have shown promising results on in-distribution (ID) datasets with similar spatial configurations. How…

DiagnosticImage GenerationLayout-to-Image Generation