Learning View and Target Invariant Visual Servoing for Navigation
The advances in deep reinforcement learning recently revived interest in data-driven learning based approaches to navigation. In this paper we propose to learn viewpoint invariant and target invariant visual servoing for local mobile robot navigation; given an initial view and the goal view or an image of a target, we train deep convolutional network controller to reach the desired goal. We present a new architecture for this task which rests on the ability of establishing correspondences between the initial and goal view and novel reward structure motivated by the traditional feedback control error. The advantage of the proposed model is that it does not require calibration and depth information and achieves robust visual servoing in a variety of environments and targets without any parameter fine tuning. We present comprehensive evaluation of the approach and comparison with other deep learning architectures as well as classical visual servoing methods in visually realistic simulation environment. The presented model overcomes the brittleness of classical visual servoing based methods and achieves significantly higher generalization capability compared to the previous learning approaches.
Code (1)
Tasks
Deep Reinforcement LearningReinforcement LearningRobot NavigationSimilar Papers 제목 키워드 기반
Sim2Real View Invariant Visual Servoing by Recurrent Control
Humans are remarkably proficient at controlling their limbs and tools from a wide range of viewpoints and angles, even in the presence of optical distortions. In robotics, this ability is referred to as visual servoing: …
Reinforcement LearningSim2Real Viewpoint Invariant Visual Servoing by Recurrent Control
Humans are remarkably proficient at controlling their limbs and tools from a wide range of viewpoints. In robotics, this ability is referred to as visual servoing: moving a tool or end-point to a desired location using p…
Reinforcement LearningRobot ManipulationLast-Meter Precision Navigation for UAVs: A Diffusion-Refined Aerial Visual Servoing Approach
In this work, we study the last-meter precision navigation for UAVs, e.g., autonomously reaching a target within the final 10 meters using monocular vision. This task is challenging due to scale ambiguity, rotation disco…
Spatial ReasoningDIViS: Domain Invariant Visual Servoing for Collision-Free Goal Reaching
Robots should understand both semantics and physics to be functional in the real world. While robot platforms provide means for interacting with the physical world they cannot autonomously acquire object-level semantics …
Learning Visual Servoing with Deep Features and Fitted Q-Iteration
Visual servoing involves choosing actions that move a robot in response to observations from a camera, in order to reach a goal configuration in the world. Standard visual servoing approaches typically rely on manually d…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)