A Compromise Principle in Deep Monocular Depth Estimation
Monocular depth estimation, which plays a key role in understanding 3D scene geometry, is fundamentally an ill-posed problem. Existing methods based on deep convolutional neural networks (DCNNs) have examined this problem by learning convolutional networks to estimate continuous depth maps from monocular images. However, we find that training a network to predict a high spatial resolution continuous depth map often suffers from poor local solutions. In this paper, we hypothesize that achieving a compromise between spatial and depth resolutions can improve network training. Based on this "compromise principle", we propose a regression-classification cascaded network (RCCN), which consists of a regression branch predicting a low spatial resolution continuous depth map and a classification branch predicting a high spatial resolution discrete depth map. The two branches form a cascaded structure allowing the classification and regression branches to benefit from each other. By leveraging large-scale raw training datasets and some data augmentation strategies, our network achieves top or state-of-the-art results on the NYU Depth V2, KITTI, and Make3D benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationData AugmentationDepth EstimationGeneral ClassificationMonocular Depth EstimationregressionSimilar Papers 제목 키워드 기반
Dense Geometry Supervision for Underwater Depth Estimation
The field of monocular depth estimation is continually evolving with the advent of numerous innovative models and extensions. However, research on monocular depth estimation methods specifically for underwater scenes rem…
Depth EstimationMonocular Depth EstimationMonocular Depth Estimation Primed by Salient Point Detection and Normalized Hessian Loss
Deep neural networks have recently thrived on single image depth estimation. That being said, current developments on this topic highlight an apparent compromise between accuracy and network size. This work proposes an a…
Depth EstimationMonocular Depth EstimationLearning Geometry-Guided Depth via Projective Modeling for Monocular 3D Object Detection
As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth es…
3D Object DetectionAutonomous DrivingDepth EstimationMonocular 3D Object Detection+4Monocular Depth Estimation through Virtual-world Supervision and Real-world SfM Self-Supervision
Depth information is essential for on-board perception in autonomous driving and driver assistance. Monocular depth estimation (MDE) is very appealing since it allows for appearance and depth being on direct pixelwise co…
Autonomous DrivingDepth EstimationMonocular Depth EstimationTowards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer
The success of monocular depth estimation relies on large and diverse training sets. Due to the challenges associated with acquiring dense ground-truth depth across different environments at scale, a number of datasets w…
Depth EstimationMonocular Depth Estimation