paper-with-me

홈 › Papers

DocAligner: Annotating Real-world Photographic Document Images by Simply Taking Pictures

2023-06-09 · Jiaxin Zhang, Bangdong Chen, Hiuyi Cheng, Fengjun Guo, Kai Ding, Lianwen Jin

Recently, there has been a growing interest in research concerning document image analysis and recognition in photographic scenarios. However, the lack of labeled datasets for this emerging challenge poses a significant obstacle, as manual annotation can be time-consuming and impractical. To tackle this issue, we present DocAligner, a novel method that streamlines the manual annotation process to a simple step of taking pictures. DocAligner achieves this by establishing dense correspondence between photographic document images and their clean counterparts. It enables the automatic transfer of existing annotations in clean document images to photographic ones and helps to automatically acquire labels that are unavailable through manual labeling. Considering the distinctive characteristics of document images, DocAligner incorporates several innovative features. First, we propose a non-rigid pre-alignment technique based on the document's edges, which effectively eliminates interference caused by significant global shifts and repetitive patterns present in document images. Second, to handle large shifts and ensure high accuracy, we introduce a hierarchical aligning approach that combines global and local correlation layers. Furthermore, considering the importance of fine-grained elements in document images, we present a details recurrent refinement module to enhance the output in a high-resolution space. To train DocAligner, we construct a synthetic dataset and introduce a self-supervised learning approach to enhance its robustness for real-world data. Through extensive experiments, we demonstrate the effectiveness of DocAligner and the acquired dataset. Datasets and codes will be publicly available.

📄 PDF Abstract BibTeX arXiv:2306.05749

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised Learning

Similar Papers 제목 키워드 기반

MDPBench: A Benchmark for Multilingual Document Parsing in Real-World Scenarios

2026-03-30 · Zhang Li, Zhibo Lin, Qiang Liu, Ziyang Zhang 외 arxiv

We introduce Multilingual Document Parsing Benchmark, the first benchmark for multilingual digital and photographed document parsing. Document parsing has made remarkable strides, yet almost exclusively on clean, digital…

Generative Photographic Control for Scene-Consistent Video Cinematic Editing

2025-11-17 · Huiqiang Sun, Liao Shen, Zhan Peng, Kun Wang 외 arxiv

Cinematic storytelling is profoundly shaped by the artful manipulation of photographic elements such as depth of field and exposure. These effects are crucial in conveying mood and creating aesthetic appeal. However, con…

Objects of violence: synthetic data for practical ML in human rights investigations

2020-04-01 · Lachlan Kermode, Jan Freyberg, Alican Akturk, Robert Trafford 외

We introduce a machine learning workflow to search for, identify, and meaningfully triage videos and images of munitions, weapons, and military equipment, even when limited training data exists for the object of interest…

How Does Latent Semantic Analysis Work? A Visualisation Approach

2014-02-03 · Jan Koeman, William Rea

By using a small example, an analogy to photographic compression, and a simple visualization using heatmaps, we show that latent semantic analysis (LSA) is able to extract what appears to be semantic meaning of words fro…

Identifying materials of photographic images and photorealistic computer generated graphics based on deep CNNs

2018-01-10 · Qi Cui, Suzanne McIntosh, Huiyu Sun

Currently, some photorealistic computer graphics are very similar to photographic images. Photorealistic computer generated graphics can be forged as photographic images, causing serious security problems. The aim of thi…