paper-with-me

홈 › Papers

MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty

2023-11-10 · Remi Marsal Florian Chabot, Angelique Loesch, William Grolleau, Hichem Sahbi

Self-supervised monocular depth estimation methods aim to be used in critical applications such as autonomous vehicles for environment analysis. To circumvent the potential imperfections of these approaches, a quantification of the prediction confidence is crucial to guide decision-making systems that rely on depth estimation. In this paper, we propose MonoProb, a new unsupervised monocular depth estimation method that returns an interpretable uncertainty, which means that the uncertainty reflects the expected error of the network in its depth predictions. We rethink the stereo or the structure-from-motion paradigms used to train unsupervised monocular depth models as a probabilistic problem. Within a single forward pass inference, this model provides a depth prediction and a measure of its confidence, without increasing the inference time. We then improve the performance on depth and uncertainty with a novel self-distillation loss for which a student is supervised by a pseudo ground truth that is a probability distribution on depth output by a teacher. To quantify the performance of our models we design new metrics that, unlike traditional ones, measure the absolute performance of uncertainty predictions. Our experiments highlight enhancements achieved by our method on standard depth and uncertainty metrics as well as on our tailored metrics. https://github.com/CEA-LIST/MonoProb

📄 PDF Abstract BibTeX arXiv:2311.06137

Code (1)

cea-list/monoprob 공식 구현 pytorch

Tasks

Autonomous VehiclesDecision MakingDepth EstimationDepth PredictionMonocular Depth EstimationUnsupervised Monocular Depth Estimation

Similar Papers 제목 키워드 기반

SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning

2022-03-10 · Jaehoon Choi, Dongki Jung, Yonghan Lee, Deokhwa Kim 외

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (S…

Depth EstimationMonocular Depth EstimationRobot NavigationSelf-Supervised Learning+1

RealMonoDepth: Self-Supervised Monocular Depth Estimation for General Scenes

2020-04-14 · Mertalp Ocal, Armin Mustafa

We present a generalised self-supervised learning approach for monocular estimation of the real depth across scenes with diverse depth ranges from 1--100s of meters. Existing supervised methods for monocular depth estima…

Depth EstimationMonocular Depth EstimationSelf-Supervised Learning

FusionDepth: Complement Self-Supervised Monocular Depth Estimation with Cost Volume

2023-05-10 · Zhuofei Huang, Jianlin Liu, Shang Xu, Ying Chen 외

Multi-view stereo depth estimation based on cost volume usually works better than self-supervised monocular depth estimation except for moving objects and low-textured surfaces. So in this paper, we propose a multi-frame…

Depth EstimationMonocular Depth EstimationStereo Depth Estimation

A high-precision self-supervised monocular visual odometry in foggy weather based on robust cycled generative adversarial networks and multi-task learning aided depth estimation

2022-03-09 · Xiuyuan Li, Jiangang Yu, Fengchao Li, Guowen An

This paper proposes a high-precision self-supervised monocular VO, which is specifically designed for navigation in foggy weather. A cycled generative adversarial network is designed to obtain high-quality self-supervise…

Depth EstimationGenerative Adversarial NetworkMonocular Visual OdometryMulti-Task Learning+2

Image Masking for Robust Self-Supervised Monocular Depth Estimation

2022-10-05 · Hemang Chawla, Kishaan Jeeveswaran, Elahe Arani, Bahram Zonooz

Self-supervised monocular depth estimation is a salient task for 3D scene understanding. Learned jointly with monocular ego-motion estimation, several methods have been proposed to predict accurate pixel-wise depth witho…

Autonomous DrivingDepth EstimationMonocular Depth EstimationMotion Estimation+1