paper-with-me

홈 › Papers

Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents

2020-09-07 · Samyak Datta, Oleksandr Maksymets, Judy Hoffman, Stefan Lee, Dhruv Batra, Devi Parikh

Recent work has presented embodied agents that can navigate to point-goal targets in novel indoor environments with near-perfect accuracy. However, these agents are equipped with idealized sensors for localization and take deterministic actions. This setting is practically sterile by comparison to the dirty reality of noisy sensors and actuations in the real world -- wheels can slip, motion sensors have error, actuations can rebound. In this work, we take a step towards this noisy reality, developing point-goal navigation agents that rely on visual estimates of egomotion under noisy action dynamics. We find these agents outperform naive adaptions of current point-goal agents to this setting as well as those incorporating classic localization baselines. Further, our model conceptually divides learning agent dynamics or odometry (where am I?) from task-specific navigation policy (where do I want to go?). This enables a seamless adaption to changing dynamics (a different robot or floor type) by simply re-calibrating the visual odometry model -- circumventing the expense of re-training of the navigation policy. Our agent was the runner-up in the PointNav track of CVPR 2020 Habitat Challenge.

📄 PDF Abstract BibTeX arXiv:2009.03231

Code (0)

등록된 구현이 없습니다.

Tasks

NavigateRobot NavigationVisual Odometry

Methods 이 논문이 사용한 방법론

AM 설명 없음
DD-PPO Decentralized Distributed Proximal Policy Optimization (DD-PPO) is a method for distributed reinforcement learning in resource-intensive simulated environments. DD-PPO is…

Similar Papers 제목 키워드 기반

The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation

2021-08-26 · ICCV 2021 10 · Xiaoming Zhao, Harsh Agrawal, Dhruv Batra, Alexander Schwing

It is fundamental for personal robots to reliably navigate to a specified goal. To study this task, PointGoal navigation has been introduced in simulated Embodied AI environments. Recent advances solve this PointGoal nav…

NavigatePointGoal NavigationVisual Odometry

EAGLE: Episodic Appearance- and Geometry-aware Memory for Unified 2D-3D Visual Query Localization in Egocentric Vision

2025-11-11 · Yifei Cao, Yu Liu, Guolong Wang, Zhu Liu 외 arxiv

Egocentric visual query localization is vital for embodied AI and VR/AR, yet remains challenging due to camera motion, viewpoint changes, and appearance variations. We present EAGLE, a novel framework that leverages epis…

Egocentric Activity Recognition and Localization on a 3D Map

2021-05-20 · Miao Liu, Lingni Ma, Kiran Somasundaram, Yin Li 외

Given a video captured from a first person perspective and the environment context of where the video is recorded, can we recognize what the person is doing and identify where the action occurs in the 3D space? We addres…

Action LocalizationAction RecognitionActivity RecognitionEgocentric Activity Recognition+1

HERO-VQL: Hierarchical, Egocentric and Robust Visual Query Localization

2025-08-30 · Joohyun Chang, Soyeon Hong, Hyogun Lee, Seong Jong Ha 외 arxiv

In this work, we tackle the egocentric visual query localization (VQL), where a model should localize the query object in a long-form egocentric video. Frequent and abrupt viewpoint changes in egocentric videos cause sig…

Object LocalizationObject Recognition

Egocentric Field-of-View Localization Using First-Person Point-of-View Devices

2015-10-07 · Vinay Bettadapura, Irfan Essa, Caroline Pantofaru

We present a technique that uses images, videos and sensor data taken from first-person point-of-view devices to perform egocentric field-of-view (FOV) localization. We define egocentric FOV localization as capturing the…