Exploring Self-Attention for Visual Odometry
Visual odometry networks commonly use pretrained optical flow networks in order to derive the ego-motion between consecutive frames. The features extracted by these networks represent the motion of all the pixels between frames. However, due to the existence of dynamic objects and texture-less surfaces in the scene, the motion information for every image region might not be reliable for inferring odometry due to the ineffectiveness of dynamic objects in derivation of the incremental changes in position. Recent works in this area lack attention mechanisms in their structures to facilitate dynamic reweighing of the feature maps for extracting more refined egomotion information. In this paper, we explore the effectiveness of self-attention in visual odometry. We report qualitative and quantitative results against the SOTA methods. Furthermore, saliency-based studies alongside specially designed experiments are utilized to investigate the effect of self-attention on VO. Our experiments show that using self-attention allows for the extraction of better features while achieving a better odometry performance compared to networks that lack such structures.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationVisual OdometrySimilar Papers 제목 키워드 기반
An Attention-Based Deep Learning Architecture for Real-Time Monocular Visual Odometry: Applications to GPS-free Drone Navigation
Drones are increasingly used in fields like industry, medicine, research, disaster relief, defense, and security. Technical challenges, such as navigation in GPS-denied environments, hinder further adoption. Research in …
Drone navigationMonocular Visual OdometryVisual OdometryORB-SfMLearner: ORB-Guided Self-supervised Visual Odometry with Selective Online Adaptation
Deep visual odometry, despite extensive research, still faces limitations in accuracy and generalizability that prevent its broader application. To address these challenges, we propose an Oriented FAST and Rotated BRIEF …
Motion EstimationVisual OdometryDense-depth map guided deep Lidar-Visual Odometry with Sparse Point Clouds and Images
Odometry is a critical task for autonomous systems for self-localization and navigation. We propose a novel LiDAR-Visual odometry framework that integrates LiDAR point clouds and images for accurate and robust pose estim…
Depth CompletionPose EstimationVisual OdometryPoint CloudsTransformer-Based Model for Monocular Visual Odometry: A Video Understanding Approach
Estimating the camera's pose given images from a single camera is a traditional task in mobile robots and autonomous vehicles. This problem is called monocular visual odometry and often relies on geometric approaches tha…
Autonomous VehiclesMonocular Visual OdometryVideo UnderstandingVisual OdometryD3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
We propose D3VO as a novel framework for monocular visual odometry that exploits deep networks on three levels -- deep depth, pose and uncertainty estimation. We first propose a novel self-supervised monocular depth esti…
Depth EstimationMonocular Depth EstimationMonocular Visual OdometryVisual Odometry