Variational Monocular Depth Estimation for Reliability Prediction
Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach, that requires a lot of ground truths. Previous works have successfully improved the accuracy of depth estimation by modifying the model structure, adding objectives, and masking dynamic objects and occluded area. However, when using such estimated depth image in applications, such as autonomous vehicles, and robots, we have to uniformly believe the estimated depth at each pixel position. This could lead to fatal errors in performing the tasks, because estimated depth at some pixels may make a bigger mistake. In this paper, we theoretically formulate a variational model for the monocular depth estimation to predict the reliability of the estimated depth image. Based on the results, we can exclude the estimated depths with low reliability or refine them for actual use. The effectiveness of the proposed method is quantitatively and qualitatively demonstrated using the KITTI benchmark and Make3D dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesDepth EstimationMonocular Depth EstimationPredictionSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors
Accurate 3D mapping in endoscopy enables quantitative, holistic lesion characterization within the gastrointestinal (GI) tract, requiring reliable depth and pose estimation. However, endoscopy systems are monocular, and …
Pose EstimationMonocular Depth Estimation Using Whole Strip Masking and Reliability-Based Refinement
We propose a monocular depth estimation algorithm, which extracts a depth map from a single image, based on whole strip masking (WSM) and reliability-based refinement. First, we develop a convolutional neural network (CN…
Depth EstimationMonocular Depth EstimationRethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask
Due to the optical properties, transparent objects often lead depth cameras to generate incomplete or invalid depth data, which in turn reduces the accuracy and reliability of robotic grasping. Existing approaches typica…
Monocular Depth EstimationDepth CompletionRobotic GraspingCDPR: Cross-modal Diffusion with Polarization for Reliable Monocular Depth Estimation
Monocular depth estimation is a fundamental yet challenging task in computer vision, especially under complex conditions such as textureless surfaces, transparency, and specular reflections. Recent diffusion-based approa…
Monocular Depth EstimationUnderwater Monocular Metric Depth Estimation: Real-World Benchmarks and Synthetic Fine-Tuning
Monocular depth estimation has recently advanced to provide not only relative but also metric depth predictions. However, its reliability in underwater environments remains limited due to light attenuation and scattering…
Depth EstimationDomain AdaptationMonocular Depth Estimation