paper-with-me

홈 › Papers

MarineFormer: A Spatio-Temporal Attention Model for USV Navigation in Dynamic Marine Environments

2024-10-17 · Ehsan Kazemi, Iman Soltani

Navigating autonomously in marine environments including dynamic and static obstacles, and strong flow disturbances, such as in high-flow rivers, poses significant challenges for USVs. To address these challenges, we propose a novel methodology that leverages two types of attention: spatial attention, which learns to integrate diverse environmental factors and sensory information into navigation decisions, and temporal attention within a transformer framework to account for the dynamic, continuously changing nature of the environment. We devise MarineFormer, a Trans${\bf \text{former}}$-based navigation policy for dynamic ${\bf \text{Marine}}$ environments, trained end-to-end through reinforcement learning (RL). At its core, MarineFormer uses graph attention to capture spatial information and a transformer architecture to process temporal sequences in an environment that simulates a 2D turbulent marine condition involving multiple static and dynamic obstacles. We extensively evaluate the performance of the proposed method versus the state-of-the-art methods, as well as other classical planners. Our approach outperforms the state-of-the-art by nearly $20\%$ in episode completion success rate and additionally enhances the USV's path length efficiency.

📄 PDF Abstract BibTeX arXiv:2410.13973

Code (0)

등록된 구현이 없습니다.

Tasks

Collision AvoidanceGraph AttentionReinforcement Learning (RL)Temporal Sequences

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integration

2025-12-26 · Wen Jiang, Li Wang, Kangyao Huang, Wei Fan 외 arxiv

Unmanned aerial vehicles (UAVs) are crucial tools for post-disaster search and rescue, facing challenges such as high information density, rapid changes in viewpoint, and dynamic structures, especially in long-horizon na…

Image Compression

STRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation

2026-04-03 · Hao Ren, Zetong Bi, Yiming Zeng, Zhaoliang Wan 외 arxiv

Visual navigation requires the robot to reach a specified goal such as an image, based on a sequence of first-person visual observations. While recent learning-based approaches have made significant progress, they often …

Visual Navigation

History-Conditioned Spatio-Temporal Visual Token Pruning for Efficient Vision-Language Navigation

2026-03-06 · Qitong Wang, Yijun Liang, Ming Li, Tianyi Zhou 외 arxiv

Vision-Language Navigation (VLN) enables robots to follow natural-language instructions in visually grounded environments, serving as a key capability for embodied robotic systems. Recent Vision-Language-Action (VLA) mod…

Vision-Language Navigation

A Solution to Time-Varying Markov Decision Processes

2016-05-03 · Lantao Liu, Gaurav S. Sukhatme

We consider a decision-making problem where the environment varies both in space and time. Such problems arise naturally when considering e.g., the navigation of an underwater robot amidst ocean currents or the navigatio…

Decision Making

Beyond Pixels: Introducing Geometric-Semantic World Priors for Video-based Embodied Models via Spatio-temporal Alignment

2025-08-29 · Jinzhou Tang, Jusheng zhang, Sidi Liu, Waikit Xiu 외 arxiv

Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene u…

Scene UnderstandingQuestion Answering