MVDepthNet: Real-time Multiview Depth Estimation Neural Network
Although deep neural networks have been widely applied to computer vision problems, extending them into multiview depth estimation is non-trivial. In this paper, we present MVDepthNet, a convolutional network to solve the depth estimation problem given several image-pose pairs from a localized monocular camera in neighbor viewpoints. Multiview observations are encoded in a cost volume and then combined with the reference image to estimate the depth map using an encoder-decoder network. By encoding the information from multiview observations into the cost volume, our method achieves real-time performance and the flexibility of traditional methods that can be applied regardless of the camera intrinsic parameters and the number of images. Geometric data augmentation is used to train MVDepthNet. We further apply MVDepthNet in a monocular dense mapping system that continuously estimates depth maps using a single localized moving camera. Experiments show that our method can generate depth maps efficiently and precisely.
Code (1)
Tasks
Data AugmentationDecoderDepth EstimationSimilar Papers 제목 키워드 기반
Dense Depth Estimation from Multiple 360-degree Images Using Virtual Depth
In this paper, we propose a dense depth estimation pipeline for multiview 360{\deg} images. The proposed pipeline leverages a spherical camera model that compensates for radial distortion in 360{\deg} images. The key con…
Depth EstimationTranslationDCHM: Depth-Consistent Human Modeling for Multiview Detection
Multiview pedestrian detection typically involves two stages: human modeling and pedestrian localization. Human modeling represents pedestrians in 3D space by fusing multiview information, making its quality crucial for …
Pedestrian DetectionMultiview DetectionDepth EstimationPoint CloudsLarge-scale Multiview 3D Hand Pose Dataset
Accurate hand pose estimation at joint level has several uses on human-robot interaction, user interfacing and virtual reality applications. Yet, it currently is not a solved problem. The novel deep learning techniques c…
Deep LearningHand Pose EstimationPose EstimationUfM*: Uncertainty from Motion* for DNN Depth Estimation Using Gaussians
Reliable uncertainty estimation is critical for deploying monocular depth deep neural networks (DNNs) in safety-critical robotic systems. Conventional uncertainty methods such as ensembles and sampling-based approaches r…
Depth EstimationOutdoor inverse rendering from a single image using multiview self-supervision
In this paper we show how to perform scene-level inverse rendering to recover shape, reflectance and lighting from a single, uncontrolled image using a fully convolutional neural network. The network takes an RGB image a…
Intrinsic Image DecompositionInverse Rendering