Integrated Decision and Control for High-Level Automated Vehicles by Mixed Policy Gradient and Its Experiment Verification

2022-10-19 · Yang Guan, Liye Tang, Chuanxiao Li, Shengbo Eben Li, Yangang Ren, Junqing Wei, Bo Zhang, Keqiang Li

Self-evolution is indispensable to realize full autonomous driving. This paper presents a self-evolving decision-making system based on the Integrated Decision and Control (IDC), an advanced framework built on reinforcement learning (RL). First, an RL algorithm called constrained mixed policy gradient (CMPG) is proposed to consistently upgrade the driving policy of the IDC. It adapts the MPG under the penalty method so that it can solve constrained optimization problems using both the data and model. Second, an attention-based encoding (ABE) method is designed to tackle the state representation issue. It introduces an embedding network for feature extraction and a weighting network for feature fusion, fulfilling order-insensitive encoding and importance distinguishing of road users. Finally, by fusing CMPG and ABE, we develop the first data-driven decision and control system under the IDC architecture, and deploy the system on a fully-functional self-driving vehicle running in daily operation. Experiment results show that boosting by data, the system can achieve better driving ability over model-based methods. It also demonstrates safe, efficient and smart driving behavior in various complex scenes at a signalized intersection with real mixed traffic flow.

📄 PDF Abstract BibTeX arXiv:2210.10613

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Decision Making Reinforcement Learning (RL)

Integrated Longitudinal Speed Decision-Making and Energy Efficiency Control for Connected Electrified Vehicles

2020-07-24 · Teng Liu, Bo wang, Dongpu Cao, Xiaolin Tang 외

To improve the driving mobility and energy efficiency of connected autonomous electrified vehicles, this paper presents an integrated longitudinal speed decision-making and energy efficiency control strategy. The propose…

Autonomous Vehicles Decision Making Model Predictive Control reinforcement-learning+2

Integrated Decision and Control: Towards Interpretable and Computationally Efficient Driving Intelligence

2021-03-18 · Yang Guan, Yangang Ren, Qi Sun, Shengbo Eben Li 외

Decision and control are core functionalities of high-level automated vehicles. Current mainstream methods, such as functionality decomposition and end-to-end reinforcement learning (RL), either suffer high time complexi…

Autonomous Driving Model-based Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Learning When to Drive in Intersections by Combining Reinforcement Learning and Model Predictive Control

2019-08-01 · Tommy Tram, Ivo Batkovic, Mohammad Ali, Jonas Sjöberg

In this paper, we propose a decision making algorithm intended for automated vehicles that negotiate with other possibly non-automated vehicles in intersections. The decision algorithm is separated into two parts: a high…

Decision Making Model Predictive Control reinforcement-learning Reinforcement Learning+1

Trust-Aware Control of Automated Vehicles in Car-Following Interactions with Human Drivers

2022-08-05 · Mehmet Fatih Ozkan, Yao Ma

Trust is essential for automated vehicles (AVs) to promote and sustain technology acceptance in human-dominated traffic scenarios. However, computational trust dynamic models describing the interactive relationship betwe…

Decision Making

Automated vehicle's behavior decision making using deep reinforcement learning and high-fidelity simulation environment

2018-04-17 · Yingjun Ye, Xiaohui Zhang, Jian Sun

Automated vehicles are deemed to be the key element for the intelligent transportation system in the future. Many studies have been made to improve the Automated vehicles' ability of environment recognition and vehicle c…

Decision Making Deep Reinforcement Learning reinforcement-learning Reinforcement Learning+1