paper-with-me

Papers

Self-Supervised Geometry-Guided Initialization for Robust Monocular Visual Odometry

2024-06-03 · Takayuki Kanai, Igor Vasiljevic, Vitor Guizilini, Kazuhiro Shintani

Monocular visual odometry is a key technology in a wide variety of autonomous systems. Relative to traditional feature-based methods, that suffer from failures due to poor lighting, insufficient texture, large motions, etc., recent learning-based SLAM methods exploit iterative dense bundle adjustment to address such failure cases and achieve robust accurate localization in a wide variety of real environments, without depending on domain-specific training data. However, despite its potential, learning-based SLAM still struggles with scenarios involving large motion and object dynamics. In this paper, we diagnose key weaknesses in a popular learning-based SLAM model (DROID-SLAM) by analyzing major failure cases on outdoor benchmarks and exposing various shortcomings of its optimization process. We then propose the use of self-supervised priors leveraging a frozen large-scale pre-trained monocular depth estimation to initialize the dense bundle adjustment process, leading to robust visual odometry without the need to fine-tune the SLAM backbone. Despite its simplicity, our proposed method demonstrates significant improvements on KITTI odometry, as well as the challenging DDAD benchmark. Code and pre-trained models will be released upon publication.

📄 PDF Abstract BibTeX arXiv:2406.00929

Code (1)

TRI-ML/vidar pytorch

Tasks

Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual Odometry

Similar Papers 제목 키워드 기반

Semantically-Guided Representation Learning for Self-Supervised Monocular Depth

2020-02-27 · ICLR 2020 1 · Vitor Guizilini, Rui Hou, Jie Li, Rares Ambrus 외

Self-supervised learning is showing great promise for monocular depth estimation, using geometry as the only source of supervision. Depth networks are indeed capable of learning representations that relate visual appeara…

Depth EstimationDepth PredictionMonocular Depth EstimationRepresentation Learning+2

Self-Supervised Learning for Monocular Depth Estimation from Aerial Imagery

2020-08-17 · Max Hermann, Boitumelo Ruf, Martin Weinmann, Stefan Hinz

Supervised learning based methods for monocular depth estimation usually require large amounts of extensively annotated training data. In the case of aerial imagery, this ground truth is particularly difficult to acquire…

Depth EstimationMonocular Depth EstimationSelf-Supervised Learning

Attention meets Geometry: Geometry Guided Spatial-Temporal Attention for Consistent Self-Supervised Monocular Depth Estimation

2021-10-15 · Patrick Ruhkamp, Daoyi Gao, Hanzhi Chen, Nassir Navab 외

Inferring geometrically consistent dense 3D scenes across a tuple of temporally consecutive images remains challenging for self-supervised monocular depth prediction pipelines. This paper explores how the increasingly po…

Depth EstimationDepth PredictionMonocular Depth Estimation

Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimation

2021-08-19 · ICCV 2021 10 · Hyunyoung Jung, Eunhyeok Park, Sungjoo Yoo

Self-supervised monocular depth estimation has been widely studied, owing to its practical importance and recent promising improvements. However, most works suffer from limited supervision of photometric consistency, esp…

Depth EstimationMetric LearningMonocular Depth Estimation

RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizer

2022-05-03 · Bayram Bayramli, Junhwa Hur, Hongtao Lu

Learning scene flow from a monocular camera still remains a challenging task due to its ill-posedness as well as lack of annotated data. Self-supervised methods demonstrate learning scene flow estimation from unlabeled d…

DecoderOptical Flow EstimationScene Flow Estimation