paper-with-me

홈 › Papers

Integrated Decision and Control: Towards Interpretable and Computationally Efficient Driving Intelligence

2021-03-18 · Yang Guan, Yangang Ren, Qi Sun, Shengbo Eben Li, Haitong Ma, Jingliang Duan, Yifan Dai, Bo Cheng

Decision and control are core functionalities of high-level automated vehicles. Current mainstream methods, such as functionality decomposition and end-to-end reinforcement learning (RL), either suffer high time complexity or poor interpretability and adaptability on real-world autonomous driving tasks. In this paper, we present an interpretable and computationally efficient framework called integrated decision and control (IDC) for automated vehicles, which decomposes the driving task into static path planning and dynamic optimal tracking that are structured hierarchically. First, the static path planning generates several candidate paths only considering static traffic elements. Then, the dynamic optimal tracking is designed to track the optimal path while considering the dynamic obstacles. To that end, we formulate a constrained optimal control problem (OCP) for each candidate path, optimize them separately and follow the one with the best tracking performance. To unload the heavy online computation, we propose a model-based reinforcement learning (RL) algorithm that can be served as an approximate constrained OCP solver. Specifically, the OCPs for all paths are considered together to construct a single complete RL problem and then solved offline in the form of value and policy networks, for real-time online path selecting and tracking respectively. We verify our framework in both simulations and the real world. Results show that compared with baseline methods IDC has an order of magnitude higher online computing efficiency, as well as better driving performance including traffic efficiency and safety. In addition, it yields great interpretability and adaptability among different driving tasks. The effectiveness of the proposed method is also demonstrated in real road tests with complicated traffic conditions.

📄 PDF Abstract BibTeX arXiv:2103.10290

Code (3)

MindSpore-scientific-2/code-5/tree/main/Integrated-Gradient mindspore
idthanm/env_build tf
mahaitongdae/safe_exp_env

Tasks

Autonomous DrivingModel-based Reinforcement Learningreinforcement-learningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Inferring Temporal Logic Properties from Data using Boosted Decision Trees

2021-05-24 · Erfan Aasi, Cristian Ioan Vasile, Mahroo Bahreinian, Calin Belta

Many autonomous systems, such as robots and self-driving cars, involve real-time decision making in complex environments, and require prediction of future outcomes from limited data. Moreover, their decisions are increas…

Autonomous DrivingDecision MakingPredictionSelf-Driving Cars+2

Self-learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections

2021-10-24 · Yangang Ren, Jianhua Jiang, Dongjie Yu, Shengbo Eben Li 외

Intersection is one of the most complex and accident-prone urban scenarios for autonomous driving wherein making safe and computationally efficient decisions is non-trivial. Current research mainly focuses on the simplif…

Autonomous DrivingDecision Making

Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning

2020-01-23 · Jianyu Chen, Shengbo Eben Li, Masayoshi Tomizuka

Unlike popular modularized framework, end-to-end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize …

Autonomous DrivingDeep Reinforcement Learningreinforcement-learningReinforcement Learning+1

Verifiable Goal Recognition for Autonomous Driving with Occlusions

2022-06-28 · Cillian Brewitt, Massimiliano Tamborski, Cheng Wang, Stefano V. Albrecht

Goal recognition (GR) involves inferring the goals of other vehicles, such as a certain junction exit, which can enable more accurate prediction of their future behaviour. In autonomous driving, vehicles can encounter ma…

Autonomous DrivingAutonomous Vehicles

Integrated Decision and Control for High-Level Automated Vehicles by Mixed Policy Gradient and Its Experiment Verification

2022-10-19 · Yang Guan, Liye Tang, Chuanxiao Li, Shengbo Eben Li 외

Self-evolution is indispensable to realize full autonomous driving. This paper presents a self-evolving decision-making system based on the Integrated Decision and Control (IDC), an advanced framework built on reinforcem…

Autonomous DrivingDecision MakingReinforcement Learning (RL)