paper-with-me

Papers

Learning Surface Parameterization for Document Image Unwarping

2021-09-29 · Sagnik Das, Ke Ma, Zhixin Shu, Dimitris Samaras

In this paper, we present a novel approach to learn texture mapping for a 3D surface and apply it to document image unwarping. We propose an efficient method to learn surface parameterization by learning a continuous bijective mapping between 3D surface positions and 2D texture-space coordinates. Our surface parameterization network can be conveniently plugged into a differentiable rendering pipeline and trained using multi-view images and rendering loss. Recent work on differentiable rendering techniques for implicit surfaces has shown high-quality 3D scene reconstruction and view synthesis results. However, these methods typically learn the appearance color as a function of the surface points and lack explicit surface parameterization. Thus they do not allow texture map extraction or texture editing. By introducing explicit surface parameterization and learning with a recent differentiable renderer for implicit surfaces, we demonstrate state-of-the-art document-unwarping via texture extraction. We show that our approach can reconstruct high-frequency textures for arbitrary document shapes in both synthetic and real scenarios. We also demonstrate the usefulness of our system by applying it to document texture editing.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Scene Reconstruction

Similar Papers 제목 키워드 기반

DewarpNet: Single-Image Document Unwarping With Stacked 3D and 2D Regression Networks

2019-10-01 · ICCV 2019 10 · Sagnik Das, Ke Ma, Zhixin Shu, Dimitris Samaras 외

Capturing document images with hand-held devices in unstructured environments is a common practice nowadays. However, "casual" photos of documents are usually unsuitable for automatic information extraction, mainly due t…

3D geometryLocal DistortionMS-SSIMOptical Character Recognition (OCR)+2

End-to-End Piece-Wise Unwarping of Document Images

2021-01-01 · ICCV 2021 10 · Sagnik Das, Kunwar Yashraj Singh, Jon Wu, Erhan Bas 외

Document unwarping attempts to undo the physical deformation of the paper and recover a 'flatbed' scanned document-image for downstream tasks such as OCR. Current state-of-the-art relies on global unwarping of the do…

MS-SSIMOptical Character Recognition (OCR)SSIM

UVDoc: Neural Grid-based Document Unwarping

2023-02-06 · Floor Verhoeven, Tanguy Magne, Olga Sorkine-Hornung

Restoring the original, flat appearance of a printed document from casual photographs of bent and wrinkled pages is a common everyday problem. In this paper we propose a novel method for grid-based single-image document …

distortion correctionMS-SSIMSSIM

DocTr: Document Image Transformer for Geometric Unwarping and Illumination Correction

2021-10-25 · Hao Feng, Yuechen Wang, Wengang Zhou, Jiajun Deng 외

In this work, we propose a new framework, called Document Image Transformer (DocTr), to address the issue of geometry and illumination distortion of the document images. Specifically, DocTr consists of a geometric unwarp…

Optical Character Recognition (OCR)

DocUNet: Document Image Unwarping via a Stacked U-Net

2018-06-01 · CVPR 2018 6 · Ke Ma, Zhixin Shu, Xue Bai, Jue Wang 외

Capturing document images is a common way for digitizing and recording physical documents due to the ubiquitousness of mobile cameras. To make text recognition easier, it is often desirable to digitally flatten a documen…

Local DistortionMS-SSIMSSIM