paper-with-me

Papers

An Attention-Based Deep Learning Architecture for Real-Time Monocular Visual Odometry: Applications to GPS-free Drone Navigation

2024-04-27 · Olivier Brochu Dufour, Abolfazl Mohebbi, Sofiane Achiche

Drones are increasingly used in fields like industry, medicine, research, disaster relief, defense, and security. Technical challenges, such as navigation in GPS-denied environments, hinder further adoption. Research in visual odometry is advancing, potentially solving GPS-free navigation issues. Traditional visual odometry methods use geometry-based pipelines which, while popular, often suffer from error accumulation and high computational demands. Recent studies utilizing deep neural networks (DNNs) have shown improved performance, addressing these drawbacks. Deep visual odometry typically employs convolutional neural networks (CNNs) and sequence modeling networks like recurrent neural networks (RNNs) to interpret scenes and deduce visual odometry from video sequences. This paper presents a novel real-time monocular visual odometry model for drones, using a deep neural architecture with a self-attention module. It estimates the ego-motion of a camera on a drone, using consecutive video frames. An inference utility processes the live video feed, employing deep learning to estimate the drone's trajectory. The architecture combines a CNN for image feature extraction and a long short-term memory (LSTM) network with a multi-head attention module for video sequence modeling. Tested on two visual odometry datasets, this model converged 48% faster than a previous RNN model and showed a 22% reduction in mean translational drift and a 12% improvement in mean translational absolute trajectory error, demonstrating enhanced robustness to noise.

📄 PDF Abstract BibTeX arXiv:2404.17745

Code (0)

등록된 구현이 없습니다.

Tasks

Drone navigationMonocular Visual OdometryVisual Odometry

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Realtime Global Attention Network for Semantic Segmentation

2021-12-24 · Xi Mo, Xiangyu Chen

In this paper, we proposed an end-to-end realtime global attention neural network (RGANet) for the challenging task of semantic segmentation. Different from the encoding strategy deployed by self-attention paradigms, the…

2D Semantic SegmentationSegmentationSemantic Segmentation

Learning Deeply Supervised Good Features to Match for Dense Monocular Reconstruction

2017-11-16 · Chamara Saroj Weerasekera, Ravi Garg, Yasir Latif, Ian Reid

Visual SLAM (Simultaneous Localization and Mapping) methods typically rely on handcrafted visual features or raw RGB values for establishing correspondences between images. These features, while suitable for sparse mappi…

Depth EstimationMonocular ReconstructionSimultaneous Localization and Mapping

MVOFormer: Flow-Semantic Transformer for Robust Monocular Visual Odometry

2026-06-15 · Jituo Li, Shunwang Sun, Jialu Zhang, Xinqi Liu 외 arxiv

Monocular visual odometry (MVO) is foundational to autonomous navigation and robotic localization. However, existing learning-based MVO approaches often struggle with either a lack of interpretable, complementary feature…

Zero-shot GeneralizationDomain GeneralizationVisual Odometry

MonoMM: A Multi-scale Mamba-Enhanced Network for Real-time Monocular 3D Object Detection

2024-08-01 · Youjia Fu, Zihao Xu, Junsong Fu, Huixia Xue 외

Recent advancements in transformer-based monocular 3D object detection techniques have exhibited exceptional performance in inferring 3D attributes from single 2D images. However, most existing methods rely on resource-i…

3D Object DetectionComputational EfficiencyDepth EstimationMamba+3

Pose Graph Optimization for Unsupervised Monocular Visual Odometry

2019-03-15 · Yang Li, Yoshitaka Ushiku, Tatsuya Harada

Unsupervised Learning based monocular visual odometry (VO) has lately drawn significant attention for its potential in label-free leaning ability and robustness to camera parameters and environmental variations. However,…

Loop Closure DetectionMonocular Visual OdometryVisual Odometry