paper-with-me

홈 › Papers

Learning View and Target Invariant Visual Servoing for Navigation

2020-03-04 · Yimeng Li, Jana Kosecka

The advances in deep reinforcement learning recently revived interest in data-driven learning based approaches to navigation. In this paper we propose to learn viewpoint invariant and target invariant visual servoing for local mobile robot navigation; given an initial view and the goal view or an image of a target, we train deep convolutional network controller to reach the desired goal. We present a new architecture for this task which rests on the ability of establishing correspondences between the initial and goal view and novel reward structure motivated by the traditional feedback control error. The advantage of the proposed model is that it does not require calibration and depth information and achieves robust visual servoing in a variety of environments and targets without any parameter fine tuning. We present comprehensive evaluation of the approach and comparison with other deep learning architectures as well as classical visual servoing methods in visually realistic simulation environment. The presented model overcomes the brittleness of classical visual servoing based methods and achieves significantly higher generalization capability compared to the previous learning approaches.

📄 PDF Abstract BibTeX arXiv:2003.02327

Code (1)

GMU-vision-robotics/View-Invariant-Visual-Servoing-for-Navigation 공식 구현 pytorch

Tasks

Deep Reinforcement LearningReinforcement LearningRobot Navigation

Similar Papers 제목 키워드 기반

Sim2Real View Invariant Visual Servoing by Recurrent Control

2017-12-20 · Fereshteh Sadeghi, Alexander Toshev, Eric Jang, Sergey Levine

Humans are remarkably proficient at controlling their limbs and tools from a wide range of viewpoints and angles, even in the presence of optical distortions. In robotics, this ability is referred to as visual servoing: …

Reinforcement Learning

Sim2Real Viewpoint Invariant Visual Servoing by Recurrent Control

2018-06-01 · CVPR 2018 6 · Fereshteh Sadeghi, Alexander Toshev, Eric Jang, Sergey Levine

Humans are remarkably proficient at controlling their limbs and tools from a wide range of viewpoints. In robotics, this ability is referred to as visual servoing: moving a tool or end-point to a desired location using p…

Reinforcement LearningRobot Manipulation

Last-Meter Precision Navigation for UAVs: A Diffusion-Refined Aerial Visual Servoing Approach

2026-07-05 · Yaxuan Li, Jiarui Zeng, Shaofei Huang, Zhedong Zheng arxiv

In this work, we study the last-meter precision navigation for UAVs, e.g., autonomously reaching a target within the final 10 meters using monocular vision. This task is challenging due to scale ambiguity, rotation disco…

Spatial Reasoning

DIViS: Domain Invariant Visual Servoing for Collision-Free Goal Reaching

2019-02-18 · Fereshteh Sadeghi

Robots should understand both semantics and physics to be functional in the real world. While robot platforms provide means for interacting with the physical world they cannot autonomously acquire object-level semantics …

Learning Visual Servoing with Deep Features and Fitted Q-Iteration

2017-03-31 · Alex X. Lee, Sergey Levine, Pieter Abbeel

Visual servoing involves choosing actions that move a robot in response to observations from a camera, in order to reach a goal configuration in the world. Standard visual servoing approaches typically rely on manually d…

Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)