Unsupervised Deep Persistent Monocular Visual Odometry and Depth Estimation in Extreme Environments
In recent years, unsupervised deep learning approaches have received significant attention to estimate the depth and visual odometry (VO) from unlabelled monocular image sequences. However, their performance is limited in challenging environments due to perceptual degradation, occlusions and rapid motions. Moreover, the existing unsupervised methods suffer from the lack of scale-consistency constraints across frames, which causes that the VO estimators fail to provide persistent trajectories over long sequences. In this study, we propose an unsupervised monocular deep VO framework that predicts six-degrees-of-freedom pose camera motion and depth map of the scene from unlabelled RGB image sequences. We provide detailed quantitative and qualitative evaluations of the proposed framework on a) a challenging dataset collected during the DARPA Subterranean challenge; and b) the benchmark KITTI and Cityscapes datasets. The proposed approach outperforms both traditional and state-of-the-art unsupervised deep VO methods providing better results for both pose estimation and depth recovery. The presented approach is part of the solution used by the COSTAR team participating at the DARPA Subterranean Challenge.
Code (0)
등록된 구현이 없습니다.
Tasks
Depth EstimationMonocular Visual OdometryPose EstimationVisual OdometrySimilar Papers 제목 키워드 기반
Unsupervised Collaborative Learning of Keyframe Detection and Visual Odometry Towards Monocular Deep SLAM
In this paper we tackle the joint learning problem of keyframe detection and visual odometry towards monocular visual SLAM systems. As an important task in visual SLAM, keyframe selection helps efficient camera relocaliz…
Camera RelocalizationPose EstimationVisual OdometryUnsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction
Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estima…
Depth And Camera MotionDepth EstimationDepth PredictionMonocular Depth Estimation+1UnDeepVO: Monocular Visual Odometry through Unsupervised Deep Learning
We propose a novel monocular visual odometry (VO) system called UnDeepVO in this paper. UnDeepVO is able to estimate the 6-DoF pose of a monocular camera and the depth of its view by using deep neural networks. There are…
Deep LearningMonocular Visual OdometryVisual OdometryTraining Deep SLAM on Single Frames
Learning-based visual odometry and SLAM methods demonstrate a steady improvement over past years. However, collecting ground truth poses to train these methods is difficult and expensive. This could be resolved by traini…
Optical Flow EstimationVisual OdometryD3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth esti…
Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual Odometry