Depth Image Upsampling based on Guided Filter with Low Gradient Minimization
In this paper, we present a novel upsampling framework to enhance the spatial resolution of the depth image. In our framework, the upscaling of a low-resolution depth image is guided by a corresponding intensity images, we formulate it as a cost aggregation problem with the guided filter. However, the guided filter does not make full use of the properties of the depth image. Since depth images have quite sparse gradients, it inspires us to regularize the gradients for improving depth upscaling results. Statistics show a special property of depth images, that is, there is a non-ignorable part of pixels whose horizontal or vertical derivatives are equal to $\pm 1$. Considering this special property, we propose a low gradient regularization method which reduces the penalty for horizontal or vertical derivative $\pm1$. The proposed low gradient regularization is integrated with the guided filter into the depth image upsampling method. Experimental results demonstrate the effectiveness of our proposed approach both qualitatively and quantitatively compared with the state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth Image UpsamplingSimilar Papers 제목 키워드 기반
Lightweight Monocular Depth Estimation through Guided Decoding
We present a lightweight encoder-decoder archi- tecture for monocular depth estimation, specifically designed for embedded platforms. Our main contribution is the Guided Upsampling Block (GUB) for building the decoder of…
DecoderDepth EstimationMonocular Depth EstimationMotion Guided LIDAR-camera Self-calibration and Accelerated Depth Upsampling for Autonomous Vehicles
This work proposes a novel motion guided method for target-less self-calibration of a LiDAR and camera and use the re-projection of LiDAR points onto the image reference frame for real-time depth upsampling. The calibrat…
Autonomous VehiclesDepth EstimationSuper-ResolutionRobust Guided Image Filtering
The process of using one image to guide the filtering process of another one is called Guided Image Filtering (GIF). The main challenge of GIF is the structure inconsistency between the guidance image and the target imag…
Depth Edge Guided CNNs for Sparse Depth Upsampling
Guided sparse depth upsampling aims to upsample an irregularly sampled sparse depth map when an aligned high-resolution color image is given as guidance. Many neural networks have been designed for this task. However, th…
Robust High Quality Image Guided Depth Upsampling
Time-of-Flight (ToF) depth sensing camera is able to obtain depth maps at a high frame rate. However, its low resolution and sensitivity to the noise are always a concern. A popular solution is upsampling the obtained no…
Vocal Bursts Intensity Prediction