Deep Depth Super-Resolution : Learning Depth Super-Resolution using Deep Convolutional Neural Network
Depth image super-resolution is an extremely challenging task due to the information loss in sub-sampling. Deep convolutional neural network have been widely applied to color image super-resolution. Quite surprisingly, this success has not been matched to depth super-resolution. This is mainly due to the inherent difference between color and depth images. In this paper, we bridge up the gap and extend the success of deep convolutional neural network to depth super-resolution. The proposed deep depth super-resolution method learns the mapping from a low-resolution depth image to a high resolution one in an end-to-end style. Furthermore, to better regularize the learned depth map, we propose to exploit the depth field statistics and the local correlation between depth image and color image. These priors are integrated in an energy minimization formulation, where the deep neural network learns the unary term, the depth field statistics works as global model constraint and the color-depth correlation is utilized to enforce the local structure in depth images. Extensive experiments on various depth super-resolution benchmark datasets show that our method outperforms the state-of-the-art depth image super-resolution methods with a margin.
Code (0)
등록된 구현이 없습니다.
Tasks
Image Super-ResolutionSuper-ResolutionSimilar Papers 제목 키워드 기반
A Review of Deep Learning Based Image Super-resolution Techniques
Image super-resolution technology is the process of obtaining high-resolution images from one or more low-resolution images. With the development of deep learning, image super-resolution technology based on deep learning…
Deep LearningImage Super-ResolutionSuper-ResolutionSemantic-Aware Depth Super-Resolution in Outdoor Scenes
While depth sensors are becoming increasingly popular, their spatial resolution often remains limited. Depth super-resolution therefore emerged as a solution to this problem. Despite much progress, state-of-the-art techn…
Super-ResolutionFight Ill-Posedness With Ill-Posedness: Single-Shot Variational Depth Super-Resolution From Shading
We put forward a principled variational approach for up-sampling a single depth map to the resolution of the companion color image provided by an RGB-D sensor. We combine heterogeneous depth and color data in order to jo…
Super-ResolutionCoReGAN: Contrastive Regularized Generative Adversarial Network for Guided Depth Map Super Resolution
Consumer-grade depth sensors provide low-resolution depth maps; however, a high-resolution RGB camera is usually mounted on the same device and acquires a high-resolution image of the same scene. While deep learning and …
Contrastive LearningDecoderDepth Map Super-ResolutionGenerative Adversarial Network+1Unpaired Depth Super-Resolution in the Wild
Depth maps captured with commodity sensors are often of low quality and resolution; these maps need to be enhanced to be used in many applications. State-of-the-art data-driven methods of depth map super-resolution rely …
Depth Map Super-ResolutionImage-to-Image TranslationSuper-ResolutionTranslation