Reconstruction-based Pairwise Depth Dataset for Depth Image Enhancement Using CNN
Raw depth images captured by consumer depth cameras suffer from noisy and missing values. Despite the success of CNN-based image processing on color image restoration, similar approaches for depth enhancement have not been much addressed yet because of the lack of raw-clean pairwise dataset. In this paper, we propose a pairwise depth image dataset generation method using dense 3D surface reconstruction with a filtering method to remove low quality pairs. We also present a multi-scale Laplacian pyramid based neural network and structure preserving loss functions to progressively reduce the noise and holes from coarse to fine scales. Experimental results show that our network trained with our pairwise dataset can enhance the input depth images to become comparable with 3D reconstructions obtained from depth streams, and can accelerate the convergence of dense 3D reconstruction results.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ReconstructionDataset GenerationImage EnhancementImage RestorationMissing ValuesSurface ReconstructionSimilar Papers 제목 키워드 기반
Just-in-Time Reconstruction: Inpainting Sparse Maps using Single View Depth Predictors as Priors
We present ``just-in-time reconstruction" as real-time image-guided inpainting of a map with arbitrary scale and sparsity to generate a fully dense depth map for the image. In particular, our goal is to inpaint a sparse …
Depth EstimationDepth PredictionHSCS: Hierarchical Sparsity Based Co-saliency Detection for RGBD Images
Co-saliency detection aims to discover common and salient objects in an image group containing more than two relevant images. Moreover, depth information has been demonstrated to be effective for many computer vision tas…
Co-Salient Object DetectionSaliency DetectionRidgeSfM: Structure from Motion via Robust Pairwise Matching Under Depth Uncertainty
We consider the problem of simultaneously estimating a dense depth map and camera pose for a large set of images of an indoor scene. While classical SfM pipelines rely on a two-step approach where cameras are first estim…
From Depth What Can You See? Depth Completion via Auxiliary Image Reconstruction
Depth completion recovers dense depth from sparse measurements, e.g., LiDAR. Existing depth-only methods use sparse depth as the only input. However, these methods may fail to recover semantics consistent boundaries, or …
Depth CompletionImage ReconstructionUnsupervised Single-shot Depth Estimation using Perceptual Reconstruction
Real-time estimation of actual object depth is an essential module for various autonomous system tasks such as 3D reconstruction, scene understanding and condition assessment. During the last decade of machine learning, …
3D ReconstructionDepth EstimationFace RecognitionScene Understanding