Human-Robot Navigation using Event-based Cameras and Reinforcement Learning
This work introduces a robot navigation controller that combines event cameras and other sensors with reinforcement learning to enable real-time human-centered navigation and obstacle avoidance. Unlike conventional image-based controllers, which operate at fixed rates and suffer from motion blur and latency, this approach leverages the asynchronous nature of event cameras to process visual information over flexible time intervals, enabling adaptive inference and control. The framework integrates event-based perception, additional range sensing, and policy optimization via Deep Deterministic Policy Gradient, with an initial imitation learning phase to improve sample efficiency. Promising results are achieved in simulated environments, demonstrating robust navigation, pedestrian following, and obstacle avoidance. A demo video is available at the project website.
Code (0)
등록된 구현이 없습니다.
Tasks
Imitation LearningRobot NavigationSimilar Papers 제목 키워드 기반
SEBVS: Synthetic Event-based Visual Servoing for Robot Navigation and Manipulation
Event cameras offer microsecond latency, high dynamic range, and low power consumption, making them ideal for real-time robotic perception under challenging conditions such as motion blur, occlusion, and illumination cha…
Event-based visionObject DetectionRobot NavigationPlace Recognition with Event-based Cameras and a Neural Implementation of SeqSLAM
Event-based cameras offer much potential to the fields of robotics and computer vision, in part due to their large dynamic range and extremely high "frame rates". These attributes make them, at least in theory, particula…
Learning Active Camera for Multi-Object Navigation
Getting robots to navigate to multiple objects autonomously is essential yet difficult in robot applications. One of the key challenges is how to explore environments efficiently with camera sensors only. Existing naviga…
NavigateObjectSINRL: Socially Integrated Navigation with Reinforcement Learning using Spiking Neural Networks
Integrating autonomous mobile robots into human environments requires human-like decision-making and energy-efficient, event-based computation. Despite progress, neuromorphic methods are rarely applied to Deep Reinforcem…
Reinforcement LearningeNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation
Event cameras provide high dynamic range and microsecond-level temporal resolution, making them well-suited for indoor robot navigation, where conventional RGB cameras degrade under fast motion or low-light conditions. D…
Robot NavigationPose Estimation