paper-with-me

Papers

Learning a Representation Map for Robot Navigation using Deep Variational Autoencoder

2018-07-05 · Kaixin Hu, Peter O'Connor

The aim of this work is to use Variational Autoencoder (VAE) to learn a representation of an indoor environment that can be used for robot navigation. We use images extracted from a video, in which a camera takes a tour around a house, for training the VAE model with a 4 dimensional latent space. After the model is trained, each real frame has a corresponding representation point on manifold in the latent space, and each representation point has corresponding reconstructed image. For the navigation problem, we map the starting image and destination image to the latent space, then optimize a path on the learned manifold connecting the two points, and finally map the path back through decoder to a sequence of images. The ideal sequence of images should correspond to a route that is spatially continuous - i.e. neighbor images in the route should correspond to neighbor locations in physical space. Such a route could be used for navigation with computer vision techniques, i.e. a robot could follow the image sequence from starting location to destination in the environment step by step. We implement this algorithm, but find in our experimental results that the resulting route is not satisfactory. The route consist of several discontinuous image frames along the ideal routes, so that the route could not be followed by a robot with computer vision techniques in practice. In our evaluation, we propose two reasons for our failure to automatically find continuous routes: (1) The VAE tends to capture global structures, but discard the details; (2) the Euclidean similarity metric used for measuring continuity between house images is sub-optimal. For further work, we propose: trying other generative models like VAE-GANs which may be better at reconstructing the details to learn the representation map, and adjusting the similarity metric in the path selecting algorithm.

📄 PDF Abstract BibTeX arXiv:1807.02401

Code (1)

augustkx/VAE_learning-a-representation-for-navigation 공식 구현

Tasks

Robot Navigation

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음
USD Coin Customer Service Number +1-833-534-1729 설명 없음

Similar Papers 제목 키워드 기반

Polyline Generative Navigable Space Segmentation for Autonomous Visual Navigation

2021-10-29 · Zheng Chen, Zhengming Ding, David Crandall, Lantao Liu

Detecting navigable space is a fundamental capability for mobile robots navigating in unknown or unmapped environments. In this work, we treat visual navigable space segmentation as a scene decomposition problem and prop…

Autonomous NavigationRepresentation LearningSegmentationVisual Navigation

Occlusion-Aware Crowd Navigation Using People as Sensors

2022-10-02 · Ye-Ji Mun, Masha Itkina, Shuijing Liu, Katherine Driggs-Campbell

Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of v…

Autonomous NavigationCollision AvoidanceDeep Reinforcement Learning

World Models for Autonomous Navigation of Terrestrial Robots from LIDAR Observations

2025-12-03 · Raul Steinmetz, Fabio Demo Rosa, Victor Augusto Kich, Jair Augusto Bottega 외 arxiv

Autonomous navigation of terrestrial robots using Reinforcement Learning (RL) from LIDAR observations remains challenging due to the high dimensionality of sensor data and the sample inefficiency of model-free approaches…

Reinforcement Learning

Learning to Tune Like an Expert: Interpretable and Scene-Aware Navigation via MLLM Reasoning and CVAE-Based Adaptation

2025-07-15 · Yanbo Wang, Zipeng Fang, Lei Zhao, Weidong Chen

Service robots are increasingly deployed in diverse and dynamic environments, where both physical layouts and social contexts change over time and across locations. In these unstructured settings, conventional navigation…

Large Language ModelScene Understanding

RAE-NWM: Navigation World Model in Dense Visual Representation Space

2026-03-10 · Mingkun Zhang, Wangtian Shen, Fan Zhang, Haijian Qin 외 arxiv

Visual navigation requires agents to reach goals in complex environments through perception and planning. World models address this task by simulating action-conditioned state transitions to predict future observations. …

Visual Navigation