Exploration of Reinforcement Learning for Event Camera using Car-like Robots

2020-04-02 · Riku Arakawa, Shintaro Shiba

We demonstrate the first reinforcement-learning application for robots equipped with an event camera. Because of the considerably lower latency of the event camera, it is possible to achieve much faster control of robots compared with the existing vision-based reinforcement-learning applications using standard cameras. To handle a stream of events for reinforcement learning, we introduced an image-like feature and demonstrated the feasibility of training an agent in a simulator for two tasks: fast collision avoidance and obstacle tracking. Finally, we set up a robot with an event camera in the real world and then transferred the agent trained in the simulator, resulting in successful fast avoidance of randomly thrown objects. Incorporating event camera into reinforcement learning opens new possibilities for various robotics applications that require swift control, such as autonomous vehicles and drones, through end-to-end learning approaches.

📄 PDF Abstract BibTeX arXiv:2004.00801

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles Collision Avoidance Event-based vision reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Exploring Event Camera-based Odometry for Planetary Robots

2022-04-12 · Florian Mahlknecht, Daniel Gehrig, Jeremy Nash, Friedrich M. Rockenbauer 외

Due to their resilience to motion blur and high robustness in low-light and high dynamic range conditions, event cameras are poised to become enabling sensors for vision-based exploration on future Mars helicopter missio…

Event Camera Based Real-Time Detection and Tracking of Indoor Ground Robots

2021-02-23 · Himanshu Patel, Craig Iaboni, Deepan Lobo, Ji-won Choi 외

This paper presents a real-time method to detect and track multiple mobile ground robots using event cameras. The method uses density-based spatial clustering of applications with noise (DBSCAN) to detect the robots and …

Clustering

Creativity in Robot Manipulation with Deep Reinforcement Learning

2019-10-16 · Juan Carlos Vargas, Malhar Bhoite, Amir Barati Farimani

Deep Reinforcement Learning (DRL) has emerged as a powerful control technique in robotic science. In contrast to control theory, DRL is more robust in the thorough exploration of the environment. This capability of DRL g…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

FlyKites: Human-centric Interactive Exploration and Assistance under Limited Communication

2025-09-19 · Yuyang Zhang, Zhuoli Tian, Jinsheng Wei, Meng Guo arxiv

Fleets of autonomous robots have been deployed for exploration of unknown scenes for features of interest, e.g., subterranean exploration, reconnaissance, search and rescue missions. During exploration, the robots may en…

Memory-based Deep Reinforcement Learning for Obstacle Avoidance in UAV with Limited Environment Knowledge

2018-11-08 · Abhik Singla, Sindhu Padakandla, Shalabh Bhatnagar

This paper presents our method for enabling a UAV quadrotor, equipped with a monocular camera, to autonomously avoid collisions with obstacles in unstructured and unknown indoor environments. When compared to obstacle av…

Decision Making Deep Reinforcement Learning Reinforcement Learning Reinforcement Learning (RL)