Monocular Depth Prediction through Continuous 3D Loss
This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source datasets with camera-LIDAR sensor suites during training. Currently, accurate and affordable range sensor is not readily available. Stereo cameras and LIDARs measure depth either inaccurately or sparsely/costly. In contrast to the current point-to-point loss evaluation approach, the proposed 3D loss treats point clouds as continuous objects; therefore, it compensates for the lack of dense ground truth depth due to LIDAR's sparsity measurements. We applied the proposed loss in three state-of-the-art monocular depth prediction approaches DORN, BTS, and Monodepth2. Experimental evaluation shows that the proposed loss improves the depth prediction accuracy and produces point-clouds with more consistent 3D geometric structures compared with all tested baselines, implying the benefit of the proposed loss on general depth prediction networks. A video demo of this work is available at https://youtu.be/5HL8BjSAY4Y.
Code (2)
Tasks
Depth EstimationDepth PredictionPredictionSimilar Papers 제목 키워드 기반
Structured Depth Prediction in Challenging Monocular Video Sequences
In this paper, we tackle the problem of estimating the depth of a scene from a monocular video sequence. In particular, we handle challenging scenarios, such as non-translational camera motion and dynamic scenes, where t…
Depth EstimationDepth PredictionMonocular Depth EstimationPrediction+1Pseudo RGB-D for Self-Improving Monocular SLAM and Depth Prediction
Classical monocular Simultaneous Localization And Mapping (SLAM) and the recently emerging convolutional neural networks (CNNs) for monocular depth prediction represent two largely disjoint approaches towards building a …
Depth EstimationDepth PredictionSimultaneous Localization and MappingSelf-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volume
Monocular depth estimation has become one of the most studied applications in computer vision, where the most accurate approaches are based on fully supervised learning models. However, the acquisition of accurate and la…
Depth EstimationMonocular Depth EstimationAdaptive Discrete Disparity Volume for Self-supervised Monocular Depth Estimation
In self-supervised monocular depth estimation tasks, discrete disparity prediction has been proven to attain higher quality depth maps than common continuous methods. However, current discretization strategies often divi…
Depth EstimationMonocular Depth EstimationDisentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depth
Conventional self-supervised monocular depth prediction methods are based on a static environment assumption, which leads to accuracy degradation in dynamic scenes due to the mismatch and occlusion problems introduced by…
Depth EstimationDepth PredictionDisentanglementMonocular Depth Estimation+4