paper-with-me

Papers

Landmark Policy Optimization for Object Navigation Task

2021-09-17 · Aleksey Staroverov, Aleksandr I. Panov

This work studies object goal navigation task, which involves navigating to the closest object related to the given semantic category in unseen environments. Recent works have shown significant achievements both in the end-to-end Reinforcement Learning approach and modular systems, but need a big step forward to be robust and optimal. We propose a hierarchical method that incorporates standard task formulation and additional area knowledge as landmarks, with a way to extract these landmarks. In a hierarchy, a low level consists of separately trained algorithms to the most intuitive skills, and a high level decides which skill is needed at this moment. With all proposed solutions, we achieve a 0.75 success rate in a realistic Habitat simulator. After a small stage of additional model training in a reconstructed virtual area at a simulator, we successfully confirmed our results in a real-world case.

📄 PDF Abstract BibTeX arXiv:2109.09512

Code (0)

등록된 구현이 없습니다.

Tasks

Object

Similar Papers 제목 키워드 기반

SpaceVLN: A Zero-Shot Vision-and-Language Navigation Agent with Online Spatial Cognitive Memory and Reasoning

2026-06-08 · Yucheng Deng, Pingrui Lai, Xinhai Li, Chenjia Bai 외 arxiv

Vision-and-Language Navigation in continuous environments requires agents to understand the spatial structure of previously unseen environments in order to follow language instructions. Although foundation models have op…

Spatial Reasoning

UAS Navigation in the Real World Using Visual Observation

2022-08-25 · Yuci Han, Jianli Wei, Alper Yilmaz

This paper presents a novel end-to-end Unmanned Aerial System (UAS) navigation approach for long-range visual navigation in the real world. Inspired by dual-process visual navigation system of human's instinct: environme…

Landmark RecognitionReinforcement Learning (RL)Visual Navigation

Where are the Keys? -- Learning Object-Centric Navigation Policies on Semantic Maps with Graph Convolutional Networks

2019-09-16 · Niko Sünderhauf

Emerging object-based SLAM algorithms can build a graph representation of an environment comprising nodes for robot poses and object landmarks. However, while this map will contain static objects such as furniture or app…

ObjectSemantic SimilaritySemantic Textual Similarity

Zero-shot Object-Centric Instruction Following: Integrating Foundation Models with Traditional Navigation

2024-11-12 · Sonia Raychaudhuri, Duy Ta, Katrina Ashton, Angel X. Chang 외

Large scale scenes such as multifloor homes can be robustly and efficiently mapped with a 3D graph of landmarks estimated jointly with robot poses in a factor graph, a technique commonly used in commercial robots such as…

Instruction FollowingObjectVision-Language Navigation

Controllable Navigation Instruction Generation with Chain of Thought Prompting

2024-07-10 · Xianghao Kong, Jinyu Chen, Wenguan Wang, Hang Su 외

Instruction generation is a vital and multidisciplinary research area with broad applications. Existing instruction generation models are limited to generating instructions in a single style from a particular dataset, an…