Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depth
Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We propose a learning-based, multi-view dense depth map and odometry estimation method that uses Recurrent Neural Networks (RNN) and trains utilizing multi-view image reprojection and forward-backward flow-consistency losses. Our model can be trained in a supervised or even unsupervised mode. It is designed for depth and visual odometry estimation from video where the input frames are temporally correlated. However, it also generalizes to single-view depth estimation. Our method produces superior results to the state-of-the-art approaches for single-view and multi-view learning-based depth estimation on the KITTI driving dataset.
Code (1)
Tasks
Depth EstimationMULTI-VIEW LEARNINGVisual OdometrySimilar Papers 제목 키워드 기반
Recurrent Neural Network for (Un-)Supervised Learning of Monocular Video Visual Odometry and Depth
Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, wh…
Depth EstimationMonocular Depth EstimationMULTI-VIEW LEARNINGVisual OdometryD3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth esti…
Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual OdometryDeep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometry
Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we …
3D ReconstructionDepth EstimationDepth PredictionMonocular Visual Odometry+2Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction
Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estima…
Depth And Camera MotionDepth EstimationDepth PredictionMonocular Depth Estimation+1Enhancing self-supervised monocular depth estimation with traditional visual odometry
Estimating depth from a single image represents an attractive alternative to more traditional approaches leveraging multiple cameras. In this field, deep learning yielded outstanding results at the cost of needing large …
Depth And Camera MotionDepth EstimationMonocular Depth EstimationVisual Odometry