paper-with-me

홈 › Papers

Geometric Consistency for Self-Supervised End-to-End Visual Odometry

2018-04-11 · Ganesh Iyer, J. Krishna Murthy, Gunshi Gupta, K. Madhava Krishna, Liam Paull

With the success of deep learning based approaches in tackling challenging problems in computer vision, a wide range of deep architectures have recently been proposed for the task of visual odometry (VO) estimation. Most of these proposed solutions rely on supervision, which requires the acquisition of precise ground-truth camera pose information, collected using expensive motion capture systems or high-precision IMU/GPS sensor rigs. In this work, we propose an unsupervised paradigm for deep visual odometry learning. We show that using a noisy teacher, which could be a standard VO pipeline, and by designing a loss term that enforces geometric consistency of the trajectory, we can train accurate deep models for VO that do not require ground-truth labels. We leverage geometry as a self-supervisory signal and propose "Composite Transformation Constraints (CTCs)", that automatically generate supervisory signals for training and enforce geometric consistency in the VO estimate. We also present a method of characterizing the uncertainty in VO estimates thus obtained. To evaluate our VO pipeline, we present exhaustive ablation studies that demonstrate the efficacy of end-to-end, self-supervised methodologies to train deep models for monocular VO. We show that leveraging concepts from geometry and incorporating them into the training of a recurrent neural network results in performance competitive to supervised deep VO methods.

📄 PDF Abstract BibTeX arXiv:1804.03789

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Odometry

Similar Papers 제목 키워드 기반

Learning Monocular Visual Odometry via Self-Supervised Long-Term Modeling

2020-07-21 · ECCV 2020 8 · Yuliang Zou, Pan Ji, Quoc-Huy Tran, Jia-Bin Huang 외

Monocular visual odometry (VO) suffers severely from error accumulation during frame-to-frame pose estimation. In this paper, we present a self-supervised learning method for VO with special consideration for consistency…

GPUMonocular Visual OdometryPose EstimationPose Prediction+2

Unsupervised Depth Completion from Visual Inertial Odometry

2019-05-15 · Alex Wong, Xiaohan Fei, Stephanie Tsuei, Stefano Soatto

We describe a method to infer dense depth from camera motion and sparse depth as estimated using a visual-inertial odometry system. Unlike other scenarios using point clouds from lidar or structured light sensors, we hav…

Depth Completion

Learning by Inertia: Self-supervised Monocular Visual Odometry for Road Vehicles

2019-05-05 · Chengze Wang, Yuan Yuan, Qi. Wang

In this paper, we present iDVO (inertia-embedded deep visual odometry), a self-supervised learning based monocular visual odometry (VO) for road vehicles. When modelling the geometric consistency within adjacent frames, …

BlockingMonocular Visual OdometrySelf-Supervised LearningVisual Odometry

Self-supervised Visual-LiDAR Odometry with Flip Consistency

2021-01-05 · Bin Li, Mu Hu, Shuling Wang, Lianghao Wang 외

Most learning-based methods estimate ego-motion by utilizing visual sensors, which suffer from dramatic lighting variations and textureless scenarios. In this paper, we incorporate sparse but accurate depth measurements …

Self-Supervised Learning

SelfVIO: Self-Supervised Deep Monocular Visual-Inertial Odometry and Depth Estimation

2019-11-22 · Yasin Almalioglu, Mehmet Turan, Alp Eren Sari, Muhamad Risqi U. Saputra 외

In the last decade, numerous supervised deep learning approaches requiring large amounts of labeled data have been proposed for visual-inertial odometry (VIO) and depth map estimation. To overcome the data limitation, se…

Depth EstimationPose EstimationSelf-Supervised LearningSensor Fusion+1