paper-with-me

Papers

Navigating to Objects in Unseen Environments by Distance Prediction

2022-02-08 · Minzhao Zhu, Binglei Zhao, Tao Kong

Object Goal Navigation (ObjectNav) task is to navigate an agent to an object category in unseen environments without a pre-built map. In this paper, we solve this task by predicting the distance to the target using semantically-related objects as cues. Based on the estimated distance to the target object, our method directly choose optimal mid-term goals that are more likely to have a shorter path to the target. Specifically, based on the learned knowledge, our model takes a bird's-eye view semantic map as input, and estimates the path length from the frontier map cells to the target object. With the estimated distance map, the agent could simultaneously explore the environment and navigate to the target objects based on a simple human-designed strategy. Empirical results in visually realistic simulation environments show that the proposed method outperforms a wide range of baselines on success rate and efficiency. Real-robot experiment also demonstrates that our method generalizes well to the real world. Video at https://www.youtube.com/watch?v=R79pWVGFKS4

📄 PDF Abstract BibTeX arXiv:2202.03735

Code (0)

등록된 구현이 없습니다.

Tasks

NavigateObjectPrediction

Similar Papers 제목 키워드 기반

SupeRGB-D: Zero-shot Instance Segmentation in Cluttered Indoor Environments

2022-12-22 · Evin Pınar Örnek, Aravindhan K Krishnan, Shreekant Gayaka, Cheng-Hao Kuo 외

Object instance segmentation is a key challenge for indoor robots navigating cluttered environments with many small objects. Limitations in 3D sensing capabilities often make it difficult to detect every possible object.…

Instance SegmentationObjectSemantic SegmentationZero-Shot Instance Segmentation

PEANUT: Predicting and Navigating to Unseen Targets

2022-12-05 · ICCV 2023 1 · Albert J. Zhai, Shenlong Wang

Efficient ObjectGoal navigation (ObjectNav) in novel environments requires an understanding of the spatial and semantic regularities in environment layouts. In this work, we present a straightforward method for learning …

ObjectGoal NavigationPrediction

Pathdreamer: A World Model for Indoor Navigation

2021-05-18 · ICCV 2021 10 · Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge 외

People navigating in unfamiliar buildings take advantage of myriad visual, spatial and semantic cues to efficiently achieve their navigation goals. Towards equipping computational agents with similar capabilities, we int…

modelSemantic SegmentationVision and Language Navigation

Context-Aware Planning and Environment-Aware Memory for Instruction Following Embodied Agents

2023-08-14 · ICCV 2023 1 · Byeonghwi Kim, Jinyeon Kim, Yuyeong Kim, Cheolhong Min 외

Accomplishing household tasks requires to plan step-by-step actions considering the consequences of previous actions. However, the state-of-the-art embodied agents often make mistakes in navigating the environment and in…

Instruction FollowingVisual Navigation

AirDreamer: Generalist Drone Navigation with World Models

2026-06-02 · Zian Liu, Andong Yang, Chunkai Yang, Ruidong An 외 arxiv

Navigating a drone in unseen and cluttered environments requires reliable generalization to unseen scene layouts and understanding of environmental structure relative to the robot's capabilities. Previous methods, which …

Drone navigation