Deep Multi-view Depth Estimation with Predicted Uncertainty
In this paper, we address the problem of estimating dense depth from a sequence of images using deep neural networks. Specifically, we employ a dense-optical-flow network to compute correspondences and then triangulate the point cloud to obtain an initial depth map.Parts of the point cloud, however, may be less accurate than others due to lack of common observations or small parallax. To further increase the triangulation accuracy, we introduce a depth-refinement network (DRN) that optimizes the initial depth map based on the image's contextual cues. In particular, the DRN contains an iterative refinement module (IRM) that improves the depth accuracy over iterations by refining the deep features. Lastly, the DRN also predicts the uncertainty in the refined depths, which is desirable in applications such as measurement selection for scene reconstruction. We show experimentally that our algorithm outperforms state-of-the-art approaches in terms of depth accuracy, and verify that our predicted uncertainty is highly correlated to the actual depth error.
Code (1)
Tasks
Depth EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertainty
Single image surface normal estimation and depth estimation are closely related problems as the former can be calculated from the latter. However, the surface normals computed from the output of depth estimation methods …
Monocular Depth EstimationUfM*: Uncertainty from Motion* for DNN Depth Estimation Using Gaussians
Reliable uncertainty estimation is critical for deploying monocular depth deep neural networks (DNNs) in safety-critical robotic systems. Conventional uncertainty methods such as ensembles and sampling-based approaches r…
Depth EstimationUncertainty-Driven Dense Two-View Structure from Motion
This work introduces an effective and practical solution to the dense two-view structure from motion (SfM) problem. One vital question addressed is how to mindfully use per-pixel optical flow correspondence between two f…
Depth EstimationOptical Flow EstimationPose EstimationVocal Bursts Valence Prediction3D Distillation: Improving Self-Supervised Monocular Depth Estimation on Reflective Surfaces
Self-supervised monocular depth estimation (SSMDE) aims at predicting the dense depth maps of monocular images, by learning to minimize a photometric loss using spatially neighboring image pairs during training. Whil…
Depth EstimationMonocular Depth EstimationA technique to jointly estimate depth and depth uncertainty for unmanned aerial vehicles
When used by autonomous vehicles for trajectory planning or obstacle avoidance, depth estimation methods need to be reliable. Therefore, estimating the quality of the depth outputs is critical. In this paper, we show how…
Autonomous VehiclesDepth Aleatoric Uncertainty EstimationDepth EstimationMonocular Depth Estimation+1