MarineFormer: A Spatio-Temporal Attention Model for USV Navigation in Dynamic Marine Environments
Navigating autonomously in marine environments including dynamic and static obstacles, and strong flow disturbances, such as in high-flow rivers, poses significant challenges for USVs. To address these challenges, we propose a novel methodology that leverages two types of attention: spatial attention, which learns to integrate diverse environmental factors and sensory information into navigation decisions, and temporal attention within a transformer framework to account for the dynamic, continuously changing nature of the environment. We devise MarineFormer, a Trans${\bf \text{former}}$-based navigation policy for dynamic ${\bf \text{Marine}}$ environments, trained end-to-end through reinforcement learning (RL). At its core, MarineFormer uses graph attention to capture spatial information and a transformer architecture to process temporal sequences in an environment that simulates a 2D turbulent marine condition involving multiple static and dynamic obstacles. We extensively evaluate the performance of the proposed method versus the state-of-the-art methods, as well as other classical planners. Our approach outperforms the state-of-the-art by nearly $20\%$ in episode completion success rate and additionally enhances the USV's path length efficiency.
Code (0)
등록된 구현이 없습니다.
Tasks
Collision AvoidanceGraph AttentionReinforcement Learning (RL)Temporal SequencesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integration
Unmanned aerial vehicles (UAVs) are crucial tools for post-disaster search and rescue, facing challenges such as high information density, rapid changes in viewpoint, and dynamic structures, especially in long-horizon na…
Image CompressionSTRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation
Visual navigation requires the robot to reach a specified goal such as an image, based on a sequence of first-person visual observations. While recent learning-based approaches have made significant progress, they often …
Visual NavigationHistory-Conditioned Spatio-Temporal Visual Token Pruning for Efficient Vision-Language Navigation
Vision-Language Navigation (VLN) enables robots to follow natural-language instructions in visually grounded environments, serving as a key capability for embodied robotic systems. Recent Vision-Language-Action (VLA) mod…
Vision-Language NavigationA Solution to Time-Varying Markov Decision Processes
We consider a decision-making problem where the environment varies both in space and time. Such problems arise naturally when considering e.g., the navigation of an underwater robot amidst ocean currents or the navigatio…
Decision MakingBeyond Pixels: Introducing Geometric-Semantic World Priors for Video-based Embodied Models via Spatio-temporal Alignment
Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene u…
Scene UnderstandingQuestion Answering