paper-with-me

Papers

Zero-Shot Object Goal Visual Navigation With Class-Independent Relationship Network

2023-10-15 · Xinting Li, Shiguang Zhang, Yue Lu, Kerry Dang, Lingyan Ran

This paper investigates the zero-shot object goal visual navigation problem. In the object goal visual navigation task, the agent needs to locate navigation targets from its egocentric visual input. "Zero-shot" means that the target the agent needs to find is not trained during the training phase. To address the issue of coupling navigation ability with target features during training, we propose the Class-Independent Relationship Network (CIRN). This method combines target detection information with the relative semantic similarity between the target and the navigation target, and constructs a brand new state representation based on similarity ranking, this state representation does not include target feature or environment feature, effectively decoupling the agent's navigation ability from target features. And a Graph Convolutional Network (GCN) is employed to learn the relationships between different objects based on their similarities. During testing, our approach demonstrates strong generalization capabilities, including zero-shot navigation tasks with different targets and environments. Through extensive experiments in the AI2-THOR virtual environment, our method outperforms the current state-of-the-art approaches in the zero-shot object goal visual navigation task. Furthermore, we conducted experiments in more challenging cross-target and cross-scene settings, which further validate the robustness and generalization ability of our method. Our code is available at: https://github.com/SmartAndCleverRobot/ICRA-CIRN.

📄 PDF Abstract BibTeX arXiv:2310.09883

Code (1)

smartandcleverrobot/icra-cirn 공식 구현 pytorch

Tasks

ObjectSemantic SimilaritySemantic Textual SimilarityVisual Navigation

Similar Papers 제목 키워드 기반

Zero-shot object goal visual navigation

2022-06-15 · Qianfan Zhao, Lu Zhang, Bin He, Hong Qiao 외

Object goal visual navigation is a challenging task that aims to guide a robot to find the target object based on its visual observation, and the target is limited to the classes pre-defined in the training stage. Howeve…

Knowledge GraphsObjectSemantic SimilaritySemantic Textual Similarity+3

SemNav: A Model-Based Planner for Zero-Shot Object Goal Navigation Using Vision-Foundation Models

2025-06-04 · Arnab Debnath, Gregory J. Stein, Jana Kosecka

Object goal navigation is a fundamental task in embodied AI, where an agent is instructed to locate a target object in an unexplored environment. Traditional learning-based methods rely heavily on large-scale annotated d…

Object

Difference-Based Relational Learning for Zero-Shot Object-Goal Visual Navigation With Direct Sim-to-Real Transfer

2026-07-17 · Guolei Qi, Feitian Zhang arxiv

End-to-end deep reinforcement learning (DRL) for zero-shot object-goal visual navigation remains challenged by the sim-to-real gap, particularly variations in object appearance and restricted camera field-of-view (FoV). …

Zero-shot GeneralizationReinforcement LearningVisual Navigation

TDANet: Target-Directed Attention Network For Object-Goal Visual Navigation With Zero-Shot Ability

2024-04-12 · Shiwei Lian, Feitian Zhang

The generalization of the end-to-end deep reinforcement learning (DRL) for object-goal visual navigation is a long-standing challenge since object classes and placements vary in new test environments. Learning domain-ind…

Deep Reinforcement LearningObjectVisual Navigation

Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigation

2023-03-06 · Vishnu Sashank Dorbala, James F. Mullen Jr., Dinesh Manocha

We present LGX (Language-guided Exploration), a novel algorithm for Language-Driven Zero-Shot Object Goal Navigation (L-ZSON), where an embodied agent navigates to a uniquely described target object in a previously unsee…

Motion PlanningObjectobject-detectionObject Detection+1