DocUNet: Document Image Unwarping via a Stacked U-Net
Capturing document images is a common way for digitizing and recording physical documents due to the ubiquitousness of mobile cameras. To make text recognition easier, it is often desirable to digitally flatten a document image when the physical document sheet is folded or curved. In this paper, we develop the first learning-based method to achieve this goal. We propose a stacked U-Net with intermediate supervision to directly predict the forward mapping from a distorted image to its rectified version. Because large-scale real-world data with ground truth deformation is difficult to obtain, we create a synthetic dataset with approximately 100 thousand images by warping non-distorted document images. The network is trained on this dataset with various data augmentations to improve its generalization ability. We further create a comprehensive benchmark that covers various real-world conditions. We evaluate the proposed model quantitatively and qualitatively on the proposed benchmark, and compare it with previous non-learning-based methods.
Code (1)
Tasks
Local DistortionMS-SSIMSSIMMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
UVDoc: Neural Grid-based Document Unwarping
Restoring the original, flat appearance of a printed document from casual photographs of bent and wrinkled pages is a common everyday problem. In this paper we propose a novel method for grid-based single-image document …
distortion correctionMS-SSIMSSIMDewarpNet: Single-Image Document Unwarping With Stacked 3D and 2D Regression Networks
Capturing document images with hand-held devices in unstructured environments is a common practice nowadays. However, "casual" photos of documents are usually unsuitable for automatic information extraction, mainly due t…
3D geometryLocal DistortionMS-SSIMOptical Character Recognition (OCR)+2Geometric Representation Learning for Document Image Rectification
In document image rectification, there exist rich geometric constraints between the distorted image and the ground truth one. However, such geometric constraints are largely ignored in existing advanced solutions, which …
Representation LearningA Gated and Bifurcated Stacked U-Net Module for Document Image Dewarping
Capturing images of documents is one of the easiest and most used methods of recording them. These images however, being captured with the help of handheld devices, often lead to undesirable distortions that are hard to …
Local DistortionMS-SSIMSSIMEnd-to-End Piece-Wise Unwarping of Document Images
Document unwarping attempts to undo the physical deformation of the paper and recover a 'flatbed' scanned document-image for downstream tasks such as OCR. Current state-of-the-art relies on global unwarping of the do…
MS-SSIMOptical Character Recognition (OCR)SSIM