Visual Navigation with Spatial Attention
This work focuses on object goal visual navigation, aiming at finding the location of an object from a given class, where in each step the agent is provided with an egocentric RGB image of the scene. We propose to learn the agent's policy using a reinforcement learning algorithm. Our key contribution is a novel attention probability model for visual navigation tasks. This attention encodes semantic information about observed objects, as well as spatial information about their place. This combination of the "what" and the "where" allows the agent to navigate toward the sought-after object effectively. The attention model is shown to improve the agent's policy and to achieve state-of-the-art results on commonly-used datasets.
Code (1)
Tasks
NavigateObjectreinforcement-learningReinforcement Learning (RL)Visual NavigationSimilar Papers 제목 키워드 기반
Audio Spatially-Guided Fusion for Audio-Visual Navigation
Audio-visual Navigation refers to an agent utilizing visual and auditory information in complex 3D environments to accomplish target localization and path planning, thereby achieving autonomous navigation. The core chall…
Visual NavigationBuilding Category Graphs Representation with Spatial and Temporal Attention for Visual Navigation
Given an object of interest, visual navigation aims to reach the object's location based on a sequence of partial observations. To this end, an agent needs to 1) learn a piece of certain knowledge about the relations of …
ObjectVisual NavigationVTNet: Visual Transformer Network for Object Goal Navigation
Object goal navigation aims to steer an agent towards a target object based on observations of the agent. It is of pivotal importance to design effective visual representations of the observed scene in determining naviga…
ObjectImproving Target-driven Visual Navigation with Attention on 3D Spatial Relationships
Embodied artificial intelligence (AI) tasks shift from tasks focusing on internet images to active settings involving embodied agents that perceive and act within 3D environments. In this paper, we investigate the target…
Deep Reinforcement LearningVisual NavigationTagaVLM: Topology-Aware Global Action Reasoning for Vision-Language Navigation
Vision-Language Navigation (VLN) presents a unique challenge for Large Vision-Language Models (VLMs) due to their inherent architectural mismatch: VLMs are primarily pretrained on static, disembodied vision-language task…
Vision-Language NavigationSpatial Reasoning