Intelligent Roundabout Insertion using Deep Reinforcement Learning

2020-01-03 · Alessandro Paolo Capasso, Giulio Bacchiani, Daniele Molinari

An important topic in the autonomous driving research is the development of maneuver planning systems. Vehicles have to interact and negotiate with each other so that optimal choices, in terms of time and safety, are taken. For this purpose, we present a maneuver planning module able to negotiate the entering in busy roundabouts. The proposed module is based on a neural network trained to predict when and how entering the roundabout throughout the whole duration of the maneuver. Our model is trained with a novel implementation of A3C, which we will call Delayed A3C (D-A3C), in a synthetic environment where vehicles move in a realistic manner with interaction capabilities. In addition, the system is trained such that agents feature a unique tunable behavior, emulating real world scenarios where drivers have their own driving styles. Similarly, the maneuver can be performed using different aggressiveness levels, which is particularly useful to manage busy scenarios where conservative rule-based policies would result in undefined waits.

📄 PDF Abstract BibTeX arXiv:2001.00786

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingDeep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

A3C A3C, Asynchronous Advantage Actor Critic, is a policy gradient algorithm in reinforcement learning that maintains a policy $\pi\left(a\_{t}\mid{s}\_{t}; \theta\right)$ and…

From Simulation to Real World Maneuver Execution using Deep Reinforcement Learning

2020-05-13 · Alessandro Paolo Capasso, Giulio Bacchiani, Alberto Broggi

Deep Reinforcement Learning has proved to be able to solve many control tasks in different fields, but the behavior of these systems is not always as expected when deployed in real-world scenarios. This is mainly due to …

Autonomous Driving Deep Reinforcement Learning Domain Adaptation reinforcement-learning+1

Variational Constrained Reinforcement Learning with Application to Planning at Roundabout

2019-09-25 · Yuan Tian, Minghao Han, Lixian Zhang, Wulong Liu 외

Planning at roundabout is crucial for autonomous driving in urban and rural environments. Reinforcement learning is promising not only in dealing with complicated environment but also taking safety constraints into accou…

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

ROSA-RL: Uncertainty-Aware Roundabout Optimized Speed Advisory with Reinforcement Learning

2026-06-15 · Anna-Lena Schlamp, Jeremias Gerner, Klaus Bogenberger, Werner Huber 외 arxiv

Roundabouts challenge automated driving in mixed traffic, as heterogeneous and non-deterministic human behavior, unknown driving intentions, and high interaction complexity create uncertainty about whether the conflict z…

Reinforcement Learning

Queue-based Eco-Driving at Roundabouts with Reinforcement Learning

2024-05-01 · Anna-Lena Schlamp, Werner Huber, Stefanie Schmidtner

We address eco-driving at roundabouts in mixed traffic to enhance traffic flow and traffic efficiency in urban areas. The aim is to proactively optimize speed of automated or non-automated connected vehicles (CVs), ensur…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Safe, Efficient, Comfort, and Energy-saving Automated Driving through Roundabout Based on Deep Reinforcement Learning

2023-06-20 · Henan Yuan, Penghui Li, Bart van Arem, Liujiang Kang 외

Traffic scenarios in roundabouts pose substantial complexity for automated driving. Manually mapping all possible scenarios into a state space is labor-intensive and challenging. Deep reinforcement learning (DRL) with it…

Deep Reinforcement Learning