Robot Perception enables Complex Navigation Behavior via Self-Supervised Learning
Learning visuomotor control policies in robotic systems is a fundamental problem when aiming for long-term behavioral autonomy. Recent supervised-learning-based vision and motion perception systems, however, are often separately built with limited capabilities, while being restricted to few behavioral skills such as passive visual odometry (VO) or mobile robot visual localization. Here we propose an approach to unify those successful robot perception systems for active target-driven navigation tasks via reinforcement learning (RL). Our method temporally incorporates compact motion and visual perception data - directly obtained using self-supervision from a single image sequence - to enable complex goal-oriented navigation skills. We demonstrate our approach on two real-world driving dataset, KITTI and Oxford RobotCar, using the new interactive CityLearn framework. The results show that our method can accurately generalize to extreme environmental changes such as day to night cycles with up to an 80% success rate, compared to 30% for a vision-only navigation systems.
Code (1)
Tasks
Reinforcement Learning (RL)Self-Supervised LearningVisual LocalizationVisual OdometrySimilar Papers 제목 키워드 기반
Reinforcement Learning for Active Perception in Autonomous Navigation
This paper addresses the challenge of active perception within autonomous navigation in complex, unknown environments. Revisiting the foundational principles of active perception, we introduce an end-to-end reinforcement…
Reinforcement LearningMotion PlanningSocRATES: Towards Automated Scenario-based Testing of Social Navigation Algorithms
Current social navigation methods and benchmarks primarily focus on proxemics and task efficiency. While these factors are important, qualitative aspects such as perceptions of a robot's social competence are equally cru…
Code GenerationSocial NavigationTranslationA Study on Learning Social Robot Navigation with Multimodal Perception
Autonomous mobile robots need to perceive the environments with their onboard sensors (e.g., LiDARs and RGB cameras) and then make appropriate navigation decisions. In order to navigate human-inhabited public spaces, suc…
Decision MakingNavigateRobot NavigationSEBVS: Synthetic Event-based Visual Servoing for Robot Navigation and Manipulation
Event cameras offer microsecond latency, high dynamic range, and low power consumption, making them ideal for real-time robotic perception under challenging conditions such as motion blur, occlusion, and illumination cha…
Event-based visionObject DetectionRobot NavigationA Deep Learning Based Behavioral Approach to Indoor Autonomous Navigation
We present a semantically rich graph representation for indoor robotic navigation. Our graph representation encodes: semantic locations such as offices or corridors as nodes, and navigational behaviors such as enter offi…
Autonomous NavigationDeep Learning