SUB-Depth: Self-distillation and Uncertainty Boosting Self-supervised Monocular Depth Estimation
We propose SUB-Depth, a universal multi-task training framework for self-supervised monocular depth estimation (SDE). Depth models trained with SUB-Depth outperform the same models trained in a standard single-task SDE framework. By introducing an additional self-distillation task into a standard SDE training framework, SUB-Depth trains a depth network, not only to predict the depth map for an image reconstruction task, but also to distill knowledge from a trained teacher network with unlabelled data. To take advantage of this multi-task setting, we propose homoscedastic uncertainty formulations for each task to penalize areas likely to be affected by teacher network noise, or violate SDE assumptions. We present extensive evaluations on KITTI to demonstrate the improvements achieved by training a range of existing networks using the proposed framework, and we achieve state-of-the-art performance on this task. Additionally, SUB-Depth enables models to estimate uncertainty on depth output.
Code (1)
Tasks
Depth EstimationImage ReconstructionMonocular Depth EstimationSimilar Papers 제목 키워드 기반
Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving
Self-supervised depth estimation is challenging for safe autonomous driving under various adverse weather conditions due to sensor perception degradation. These challenges arise from two main aspects. Firstly, adverse co…
Knowledge DistillationAutonomous DrivingDepth EstimationMonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty
Self-supervised monocular depth estimation methods aim to be used in critical applications such as autonomous vehicles for environment analysis. To circumvent the potential imperfections of these approaches, a quantifica…
Autonomous VehiclesDecision MakingDepth EstimationDepth Prediction+2ProDepth: Boosting Self-Supervised Multi-Frame Monocular Depth with Probabilistic Fusion
Self-supervised multi-frame monocular depth estimation relies on the geometric consistency between successive frames under the assumption of a static scene. However, the presence of moving objects in dynamic scenes intro…
DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+13D Distillation: Improving Self-Supervised Monocular Depth Estimation on Reflective Surfaces
Self-supervised monocular depth estimation (SSMDE) aims at predicting the dense depth maps of monocular images, by learning to minimize a photometric loss using spatially neighboring image pairs during training. Whil…
Depth EstimationMonocular Depth EstimationWaterMono: Teacher-Guided Anomaly Masking and Enhancement Boosting for Robust Underwater Self-Supervised Monocular Depth Estimation
Depth information serves as a crucial prerequisite for various visual tasks, whether on land or underwater. Recently, self-supervised methods have achieved remarkable performance on several terrestrial benchmarks despite…
Depth EstimationImage EnhancementKnowledge DistillationMonocular Depth Estimation