Depth Map Completion by Jointly Exploiting Blurry Color Images and Sparse Depth Maps
We aim at predicting a complete and high-resolution depth map from incomplete, sparse and noisy depth measurements. Existing methods handle this problem either by exploiting various regularizations on the depth maps directly or resorting to learning based methods. When the corresponding color images are available, the correlation between the depth maps and the color images are used to improve the completion performance, assuming the color images are clean and sharp. However, in real world dynamic scenes, color images are often blurry due to the camera motion and the moving objects in the scene. In this paper, we propose to tackle the problem of depth map completion by jointly exploiting the blurry color image sequences and the sparse depth map measurements, and present an energy minimization based formulation to simultaneously complete the depth maps, estimate the scene flow and deblur the color images. Our experimental evaluations on both outdoor and indoor scenarios demonstrate the state-of-the-art performance of our approach.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Joint Depth Estimation and Camera Shake Removal from Single Blurry Image
Camera shake during exposure time often results in spatially variant blur effect of the image. The non-uniform blur effect is not only caused by the camera motion, but also the depth variation of the scene. The objects c…
DeblurringDepth EstimationImage MattingRigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completion
Depth completion aims to recover dense depth maps from sparse ones, where color images are often used to facilitate this task. Recent depth methods primarily focus on image guided learning frameworks. However, blurry gui…
Depth CompletionDepth EstimationDepth PredictionRigNet: Repetitive Image Guided Network for Depth Completion
Depth completion deals with the problem of recovering dense depth maps from sparse ones, where color images are often used to facilitate this task. Recent approaches mainly focus on image guided learning frameworks to pr…
Depth CompletionDepth EstimationDepth PredictionSemAttNet: Towards Attention-based Semantic Aware Guided Depth Completion
Depth completion involves recovering a dense depth map from a sparse map and an RGB image. Recent approaches focus on utilizing color images as guidance images to recover depth at invalid pixels. However, color images al…
Depth CompletionSingle Image Deblurring and Camera Motion Estimation with Depth Map
Camera shake during exposure is a major problem in hand-held photography, as it causes image blur that destroys details in the captured images.~In the real world, such blur is mainly caused by both the camera motion and …
DeblurringImage DeblurringMotion EstimationSingle Image Deblurring