MultiDepth: Single-Image Depth Estimation via Multi-Task Regression and Classification
We introduce MultiDepth, a novel training strategy and convolutional neural network (CNN) architecture that allows approaching single-image depth estimation (SIDE) as a multi-task problem. SIDE is an important part of road scene understanding. It, thus, plays a vital role in advanced driver assistance systems and autonomous vehicles. Best results for the SIDE task so far have been achieved using deep CNNs. However, optimization of regression problems, such as estimating depth, is still a challenging task. For the related tasks of image classification and semantic segmentation, numerous CNN-based methods with robust training behavior have been proposed. Hence, in order to overcome the notorious instability and slow convergence of depth value regression during training, MultiDepth makes use of depth interval classification as an auxiliary task. The auxiliary task can be disabled at test-time to predict continuous depth values using the main regression branch more efficiently. We applied MultiDepth to road scenes and present results on the KITTI depth prediction dataset. In experiments, we were able to show that end-to-end multi-task learning with both, regression and classification, is able to considerably improve training and yield more accurate results.
Code (1)
Tasks
Autonomous VehiclesClassificationDepth EstimationDepth PredictionGeneral Classificationimage-classificationImage ClassificationMulti-Task Learningregressionroad scene understandingScene UnderstandingSemantic SegmentationSimilar Papers 제목 키워드 기반
MultiDepth: Multi-Sample Priors for Refining Monocular Metric Depth Estimations in Indoor Scenes
Monocular metric depth estimation (MMDE) is a crucial task to solve for indoor scene reconstruction on edge devices. Despite this importance, existing models are sensitive to factors such as boundary frequency of objects…
DecoderDepth EstimationIndoor Scene ReconstructionOne Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models
A faithful 3D world representation should account for layered geometry, where a single camera ray may contain multiple visible and geometrically valid surfaces. Monocular depth estimation, however, reduces this structure…
Monocular Depth EstimationFS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene
It has long been an ill-posed problem to predict absolute depth maps from single images in real (unseen) indoor scenes. We observe that it is essentially due to not only the scale-ambiguous problem but also the focal-amb…
3D ReconstructionData AugmentationDepth EstimationMonocular Depth EstimationSingle Image Depth Estimation: An Overview
We review solutions to the problem of depth estimation, arguably the most important subtask in scene understanding. We focus on the single image depth estimation problem. Due to its properties, the single image depth est…
Deep LearningDepth EstimationScene UnderstandingSemantic Segmentation+1Depth Estimation from Single-shot Monocular Endoscope Image Using Image Domain Adaptation And Edge-Aware Depth Estimation
We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimati…
Depth EstimationDomain AdaptationTranslation