paper-with-me

Papers

GraphMapper: Efficient Visual Navigation by Scene Graph Generation

2022-05-17 · Zachary Seymour, Niluthpol Chowdhury Mithun, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar

Understanding the geometric relationships between objects in a scene is a core capability in enabling both humans and autonomous agents to navigate in new environments. A sparse, unified representation of the scene topology will allow agents to act efficiently to move through their environment, communicate the environment state with others, and utilize the representation for diverse downstream tasks. To this end, we propose a method to train an autonomous agent to learn to accumulate a 3D scene graph representation of its environment by simultaneously learning to navigate through said environment. We demonstrate that our approach, GraphMapper, enables the learning of effective navigation policies through fewer interactions with the environment than vision-based systems alone. Further, we show that GraphMapper can act as a modular scene encoder to operate alongside existing Learning-based solutions to not only increase navigational efficiency but also generate intermediate scene representations that are useful for other future tasks.

📄 PDF Abstract BibTeX arXiv:2205.08325

Code (0)

등록된 구현이 없습니다.

Tasks

Graph GenerationNavigateScene Graph GenerationVisual Navigation

Similar Papers 제목 키워드 기반

Primitive Graph Learning for Unified Vector Mapping

2022-06-28 · Lei Wang, Min Dai, Jianan He, Jingwei Huang 외

Large-scale vector mapping is important for transportation, city planning, and survey and census. We propose GraphMapper, a unified framework for end-to-end vector map extraction from satellite images. Our key idea is a …

Graph Learning

Regularized Primitive Graph Learning for Unified Vector Mapping

2023-01-01 · ICCV 2023 1 · Lei Wang, Min Dai, Jianan He, Jingwei Huang

Large-scale vector mapping is the foundation for transportation and urban planning. Most existing mapping methods are tailored to one specific mapping task, due to task-specific requirements on shape regularization a…

Graph LearningGraph Reconstruction

Specifying Object Attributes and Relations in Interactive Scene Generation

2019-09-11 · ICCV 2019 10 · Oron Ashual, Lior Wolf

We introduce a method for the generation of images from an input scene graph. The method separates between a layout embedding and an appearance embedding. The dual embedding leads to generated images that better match th…

Layout-to-Image GenerationObjectScene Generation

Scene Representation using 360° Saliency Graph and its Application in Vision-based Indoor Navigation

2026-03-20 · Preeti Meena, Himanshu Kumar, Sandeep Yadav arxiv

A Scene, represented visually using different formats such as RGB-D, LiDAR scan, keypoints, rectangular, spherical, multi-views, etc., contains information implicitly embedded relevant to applications such as scene index…

Predicting Topological Maps for Visual Navigation in Unexplored Environments

2022-11-23 · Huangying Zhan, Hamid Rezatofighi, Ian Reid

We propose a robotic learning system for autonomous exploration and navigation in unexplored environments. We are motivated by the idea that even an unseen environment may be familiar from previous experiences in similar…

Visual Navigation