paper-with-me

Papers

MPVO: Motion-Prior based Visual Odometry for PointGoal Navigation

2024-11-07 · Sayan Paul, Ruddra dev Roychoudhury, Brojeshwar Bhowmick

Visual odometry (VO) is essential for enabling accurate point-goal navigation of embodied agents in indoor environments where GPS and compass sensors are unreliable and inaccurate. However, traditional VO methods face challenges in wide-baseline scenarios, where fast robot motions and low frames per second (FPS) during inference hinder their performance, leading to drift and catastrophic failures in point-goal navigation. Recent deep-learned VO methods show robust performance but suffer from sample inefficiency during training; hence, they require huge datasets and compute resources. So, we propose a robust and sample-efficient VO pipeline based on motion priors available while an agent is navigating an environment. It consists of a training-free action-prior based geometric VO module that estimates a coarse relative pose which is further consumed as a motion prior by a deep-learned VO model, which finally produces a fine relative pose to be used by the navigation policy. This strategy helps our pipeline achieve up to 2x sample efficiency during training and demonstrates superior accuracy and robustness in point-goal navigation tasks compared to state-of-the-art VO method(s). Realistic indoor environments of the Gibson dataset is used in the AI-Habitat simulator to evaluate the proposed approach using navigation metrics (like success/SPL) and pose metrics (like RPE/ATE). We hope this method further opens a direction of work where motion priors from various sources can be utilized to improve VO estimates and achieve better results in embodied navigation tasks.

📄 PDF Abstract BibTeX arXiv:2411.04796

Code (0)

등록된 구현이 없습니다.

Tasks

PointGoal NavigationVisual Odometry

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…

Similar Papers 제목 키워드 기반

The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation

2021-08-26 · ICCV 2021 10 · Xiaoming Zhao, Harsh Agrawal, Dhruv Batra, Alexander Schwing

It is fundamental for personal robots to reliably navigate to a specified goal. To study this task, PointGoal navigation has been introduced in simulated Embodied AI environments. Recent advances solve this PointGoal nav…

NavigatePointGoal NavigationVisual Odometry

Unsupervised Visual Odometry and Action Integration for PointGoal Navigation in Indoor Environment

2022-10-02 · Yijun Cao, Xianshi Zhang, Fuya Luo, Chuan Lin 외

PointGoal navigation in indoor environment is a fundamental task for personal robots to navigate to a specified point. Recent studies solved this PointGoal navigation task with near-perfect success rate in photo-realisti…

NavigatePointGoal NavigationVisual Odometry

Is Mapping Necessary for Realistic PointGoal Navigation?

2022-06-02 · CVPR 2022 1 · Ruslan Partsey, Erik Wijmans, Naoki Yokoyama, Oles Dobosevych 외

Can an autonomous agent navigate in a new environment without building an explicit map? For the task of PointGoal navigation ('Go to $\Delta x$, $\Delta y$') under idealized settings (no RGB-D and actuation noise, perfec…

Data AugmentationNavigateOpen-Ended Question AnsweringPointGoal Navigation+1

MBA-VO: Motion Blur Aware Visual Odometry

2021-03-25 · ICCV 2021 10 · Peidong Liu, Xingxing Zuo, Viktor Larsson, Marc Pollefeys

Motion blur is one of the major challenges remaining for visual odometry methods. In low-light conditions where longer exposure times are necessary, motion blur can appear even for relatively slow camera motions. In this…

BenchmarkingVisual Odometry

Momo: Monocular Motion Estimation on Manifolds

2017-08-01 · Johannes Graeter, Tobias Strauss, Martin Lauer

Knowledge about the location of a vehicle is indispensable for autonomous driving. In order to apply global localisation methods, a pose prior must be known which can be obtained from visual odometry. The quality and rob…

Autonomous DrivingMotion EstimationVisual Odometry