Semantically Guided Depth Upsampling
We present a novel method for accurate and efficient up- sampling of sparse depth data, guided by high-resolution imagery. Our approach goes beyond the use of intensity cues only and additionally exploits object boundary cues through structured edge detection and semantic scene labeling for guidance. Both cues are combined within a geodesic distance measure that allows for boundary-preserving depth in- terpolation while utilizing local context. We model the observed scene structure by locally planar elements and formulate the upsampling task as a global energy minimization problem. Our method determines glob- ally consistent solutions and preserves fine details and sharp depth bound- aries. In our experiments on several public datasets at different levels of application, we demonstrate superior performance of our approach over the state-of-the-art, even for very sparse measurements.
Code (0)
등록된 구현이 없습니다.
Tasks
Edge DetectionScene LabelingSimilar Papers 제목 키워드 기반
Depth Edge Guided CNNs for Sparse Depth Upsampling
Guided sparse depth upsampling aims to upsample an irregularly sampled sparse depth map when an aligned high-resolution color image is given as guidance. Many neural networks have been designed for this task. However, th…
Depth Image Upsampling based on Guided Filter with Low Gradient Minimization
In this paper, we present a novel upsampling framework to enhance the spatial resolution of the depth image. In our framework, the upscaling of a low-resolution depth image is guided by a corresponding intensity images, …
Depth Image UpsamplingRobust High Quality Image Guided Depth Upsampling
Time-of-Flight (ToF) depth sensing camera is able to obtain depth maps at a high frame rate. However, its low resolution and sensitivity to the noise are always a concern. A popular solution is upsampling the obtained no…
Vocal Bursts Intensity PredictionMotion Guided LIDAR-camera Self-calibration and Accelerated Depth Upsampling for Autonomous Vehicles
This work proposes a novel motion guided method for target-less self-calibration of a LiDAR and camera and use the re-projection of LiDAR points onto the image reference frame for real-time depth upsampling. The calibrat…
Autonomous VehiclesDepth EstimationSuper-ResolutionLightweight Monocular Depth Estimation through Guided Decoding
We present a lightweight encoder-decoder archi- tecture for monocular depth estimation, specifically designed for embedded platforms. Our main contribution is the Guided Upsampling Block (GUB) for building the decoder of…
DecoderDepth EstimationMonocular Depth Estimation