paper-with-me

Papers

ORB-SfMLearner: ORB-Guided Self-supervised Visual Odometry with Selective Online Adaptation

2024-09-18 · Yanlin Jin, Rui-Yang Ju, Haojun Liu, Yuzhong Zhong

Deep visual odometry, despite extensive research, still faces limitations in accuracy and generalizability that prevent its broader application. To address these challenges, we propose an Oriented FAST and Rotated BRIEF (ORB)-guided visual odometry with selective online adaptation named ORB-SfMLearner. We present a novel use of ORB features for learning-based ego-motion estimation, leading to more robust and accurate results. We also introduce the cross-attention mechanism to enhance the explainability of PoseNet and have revealed that driving direction of the vehicle can be explained through the attention weights. To improve generalizability, our selective online adaptation allows the network to rapidly and selectively adjust to the optimal parameters across different domains. Experimental results on KITTI and vKITTI datasets show that our method outperforms previous state-of-the-art deep visual odometry methods in terms of ego-motion accuracy and generalizability.

📄 PDF Abstract BibTeX arXiv:2409.11692

Code (0)

등록된 구현이 없습니다.

Tasks

Motion EstimationVisual Odometry

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

EndoSLAM Dataset and An Unsupervised Monocular Visual Odometry and Depth Estimation Approach for Endoscopic Videos: Endo-SfMLearner

2020-06-30 · Kutsev Bengisu Ozyoruk, Guliz Irem Gokceler, Gulfize Coskun, Kagan Incetan 외

Deep learning techniques hold promise to develop dense topography reconstruction and pose estimation methods for endoscopic videos. However, currently available datasets do not support effective quantitative benchmarking…

BenchmarkingDepth EstimationMonocular Visual OdometryPose Estimation+3

Self-Supervised Geometry-Guided Initialization for Robust Monocular Visual Odometry

2024-06-03 · Takayuki Kanai, Igor Vasiljevic, Vitor Guizilini, Kazuhiro Shintani

Monocular visual odometry is a key technology in a wide variety of autonomous systems. Relative to traditional feature-based methods, that suffer from failures due to poor lighting, insufficient texture, large motions, e…

Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual Odometry

Self-supervised Visual-LiDAR Odometry with Flip Consistency

2021-01-05 · Bin Li, Mu Hu, Shuling Wang, Lianghao Wang 외

Most learning-based methods estimate ego-motion by utilizing visual sensors, which suffer from dramatic lighting variations and textureless scenarios. In this paper, we incorporate sparse but accurate depth measurements …

Self-Supervised Learning

D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry

2020-03-02 · CVPR 2020 6 · Nan Yang, Lukas von Stumberg, Rui Wang, Daniel Cremers

We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth esti…

Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual Odometry

WS-SfMLearner: Self-supervised Monocular Depth and Ego-motion Estimation on Surgical Videos with Unknown Camera Parameters

2023-08-22 · Ange Lou, Jack Noble

Depth estimation in surgical video plays a crucial role in many image-guided surgery procedures. However, it is difficult and time consuming to create depth map ground truth datasets in surgical videos due in part to inc…

Depth EstimationMotion Estimation