Sim-to-real reinforcement learning applied to end-to-end vehicle control

2020-12-14 · András Kalapos, Csaba Gór, Róbert Moni, István Harmati

In this work, we study vision-based end-to-end reinforcement learning on vehicle control problems, such as lane following and collision avoidance. Our controller policy is able to control a small-scale robot to follow the right-hand lane of a real two-lane road, while its training was solely carried out in a simulation. Our model, realized by a simple, convolutional network, only relies on images of a forward-facing monocular camera and generates continuous actions that directly control the vehicle. To train this policy we used Proximal Policy Optimization, and to achieve the generalization capability required for real performance we used domain randomization. We carried out thorough analysis of the trained policy, by measuring multiple performance metrics and comparing these to baselines that rely on other methods. To assess the quality of the simulation-to-reality transfer learning process and the performance of the controller in the real world, we measured simple metrics on a real track and compared these with results from a matching simulation. Further analysis was carried out by visualizing salient object maps.

📄 PDF Abstract BibTeX arXiv:2012.07461

Code (1)

kaland313/Duckietown-RL 공식 구현

Tasks

Collision Avoidance reinforcement-learning Reinforcement Learning (RL)Transfer Learning

Controlling an Autonomous Vehicle with Deep Reinforcement Learning

2019-09-24 · Andreas Folkers, Matthias Rick, Christof Büskens

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reachi…

Autonomous Vehicles Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1

Longitudinal Dynamic versus Kinematic Models for Car-Following Control Using Deep Reinforcement Learning

2019-05-07 · Yu-an Lin, John McPhee, Nasser L. Azad

The majority of current studies on autonomous vehicle control via deep reinforcement learning (DRL) utilize point-mass kinematic models, neglecting vehicle dynamics which includes acceleration delay and acceleration comm…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning for the Joint Control of Traffic Light Signaling and Vehicle Speed Advice

2023-09-18 · Johannes V. S. Busch, Robert Voelckner, Peter Sossalla, Christian L. Vielhaus 외

Traffic congestion in dense urban centers presents an economical and environmental burden. In recent years, the availability of vehicle-to-anything communication allows for the transmission of detailed vehicle states to …

Deep Reinforcement Learning

Traffic control using intelligent timing of traffic lights with reinforcement learning technique and real-time processing of surveillance camera images

2024-05-22 · Mahdi JameBozorg, Mohsen Hami, Sajjad Deh Deh Jani

Optimal management of traffic light timing is one of the most effective factors in reducing urban traffic. In most old systems, fixed timing was used along with human factors to control traffic, which is not very efficie…

Management OpenAI Gym reinforcement-learning Reinforcement Learning+2

Decision-making at Unsignalized Intersection for Autonomous Vehicles: Left-turn Maneuver with Deep Reinforcement Learning

2020-08-14 · Feng Wang, Dongjie Shi, Teng Liu, Xiaolin Tang

Decision-making module enables autonomous vehicles to reach appropriate maneuvers in the complex urban environments, especially the intersection situations. This work proposes a deep reinforcement learning (DRL) based le…

Autonomous Vehicles Decision Making Deep Reinforcement Learning Q-Learning+2