paper-with-me

홈 › Papers

3D-Aware Object Goal Navigation via Simultaneous Exploration and Identification

2022-12-01 · CVPR 2023 1 · Jiazhao Zhang, Liu Dai, Fanpeng Meng, Qingnan Fan, Xuelin Chen, Kai Xu, He Wang

Object goal navigation (ObjectNav) in unseen environments is a fundamental task for Embodied AI. Agents in existing works learn ObjectNav policies based on 2D maps, scene graphs, or image sequences. Considering this task happens in 3D space, a 3D-aware agent can advance its ObjectNav capability via learning from fine-grained spatial information. However, leveraging 3D scene representation can be prohibitively unpractical for policy learning in this floor-level task, due to low sample efficiency and expensive computational cost. In this work, we propose a framework for the challenging 3D-aware ObjectNav based on two straightforward sub-policies. The two sub-polices, namely corner-guided exploration policy and category-aware identification policy, simultaneously perform by utilizing online fused 3D points as observation. Through extensive experiments, we show that this framework can dramatically improve the performance in ObjectNav through learning from 3D scene representation. Our framework achieves the best performance among all modular-based methods on the Matterport3D and Gibson datasets, while requiring (up to 30x) less computational cost for training.

📄 PDF Abstract BibTeX arXiv:2212.00338

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Instance-aware Exploration-Verification-Exploitation for Instance ImageGoal Navigation

2024-02-25 · CVPR 2024 1 · Xiaohan Lei, Min Wang, Wengang Zhou, Li Li 외

As a new embodied vision task, Instance ImageGoal Navigation (IIN) aims to navigate to a specified object depicted by a goal image in an unexplored environment. The main challenge of this task lies in identifying the tar…

Navigate

SGoLAM: Simultaneous Goal Localization and Mapping for Multi-Object Goal Navigation

2021-10-14 · Junho Kim, Eun Sun Lee, MinGi Lee, Donsu Zhang 외

We present SGoLAM, short for simultaneous goal localization and mapping, which is a simple and efficient algorithm for Multi-Object Goal navigation. Given an agent equipped with an RGB-D camera and a GPS/Compass sensor, …

NavigateVisual Navigation

MCNav: Memory-Aware Dynamic Cognitive Map for Zero-shot Goal-oriented Navigation

2026-05-19 · Jingyu Li, Zhe Liu, Wenxiao Wu, Li Zhang arxiv

Navigating to instance-level targets in complex environments is a challenging problem. Many existing zero-shot methods achieve strong performance by modeling the entire environment and leveraging large language models fo…

Scene Understanding

Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Guided Exploration for Zero-Shot Object Navigation

2023-03-06 · Vishnu Sashank Dorbala, James F. Mullen Jr., Dinesh Manocha

We present LGX (Language-guided Exploration), a novel algorithm for Language-Driven Zero-Shot Object Goal Navigation (L-ZSON), where an embodied agent navigates to a uniquely described target object in a previously unsee…

Motion PlanningObjectobject-detectionObject Detection+1

MOPA: Modular Object Navigation with PointGoal Agents

2023-04-07 · Sonia Raychaudhuri, Tommaso Campari, Unnat Jain, Manolis Savva 외

We propose a simple but effective modular approach MOPA (Modular ObjectNav with PointGoal agents) to systematically investigate the inherent modularity of the object navigation task in Embodied AI. MOPA consists of four …

NavigateObjectobject-detectionObject Detection+1