paper-with-me

Papers

Where are the Keys? -- Learning Object-Centric Navigation Policies on Semantic Maps with Graph Convolutional Networks

2019-09-16 · Niko Sünderhauf

Emerging object-based SLAM algorithms can build a graph representation of an environment comprising nodes for robot poses and object landmarks. However, while this map will contain static objects such as furniture or appliances, many moveable objects (e.g. the car keys, the glasses, or a magazine), are not suitable as landmarks and will not be part of the map due to their non-static nature. We show that Graph Convolutional Networks can learn navigation policies to find such unmapped objects by learning to exploit the hidden probabilistic model that governs where these objects appear in the environment. The learned policies can generalise to object classes unseen during training by using word vectors that express semantic similarity as representations for object nodes in the graph. Furthermore, we show that the policies generalise to unseen environments with only minimal loss of performance. We demonstrate that pre-training the policy network with a proxy task can significantly speed up learning, improving sample efficiency.

📄 PDF Abstract BibTeX arXiv:1909.07376

Code (1)

nikosuenderhauf/graphConvNetsForNavigation 공식 구현

Tasks

ObjectSemantic SimilaritySemantic Textual Similarity

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Graph Convolutional Networks 설명 없음

Similar Papers 제목 키워드 기반

Graph-Based Multimodal and Multi-view Alignment for Keystep Recognition

2025-01-07 · Julia Lee Romero, Kyle Min, Subarna Tripathi, Morteza Karimzadeh

Egocentric videos capture scenes from a wearer's viewpoint, resulting in dynamic backgrounds, frequent motion, and occlusions, posing challenges to accurate keystep recognition. We propose a flexible graph-learning frame…

Graph LearningNode Classification

Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks

2021-08-02 · Zachary Ravichandran, Lisa Peng, Nathan Hughes, J. Daniel Griffith 외

Representations are crucial for a robot to learn effective navigation policies. Recent work has shown that mid-level perceptual abstractions, such as depth estimates or 2D semantic segmentation, lead to more effective po…

2D Semantic SegmentationGraph Neural NetworkSemantic Segmentation

IntentNav: Learning Spatial-Visual Object Navigation from Human Demonstrations

2026-06-06 · Yuxin Cai, Zongtai Li, Maonan Wang, Muyi Bao 외 arxiv

Object navigation requires a robot to search for an unobserved target in an unknown environment by deciding where to explore next under partial observability. Effective search resembles human-like exploration: selectivel…

Learning Generalizable Manipulation Policies with Object-Centric 3D Representations

2023-10-22 · Yifeng Zhu, Zhenyu Jiang, Peter Stone, Yuke Zhu

We introduce GROOT, an imitation learning method for learning robust policies with object-centric and 3D priors. GROOT builds policies that generalize beyond their initial training conditions for vision-based manipulatio…

Imitation LearningObject

IntentReact: Guiding Reactive Object-Centric Navigation via Topological Intent

2026-03-26 · Yanmei Jiao, Anpeng Lu, Wenhan Hu, Rong Xiong 외 arxiv

Object-goal visual navigation requires robots to reason over semantic structure and act effectively under partial observability. Recent approaches based on object-level topological maps enable long-horizon navigation wit…

Visual Navigation