Behavior Planning at Urban Intersections through Hierarchical Reinforcement Learning

2020-11-09 · Zhiqian Qiao, Jeff Schneider, John M. Dolan

For autonomous vehicles, effective behavior planning is crucial to ensure safety of the ego car. In many urban scenarios, it is hard to create sufficiently general heuristic rules, especially for challenging scenarios that some new human drivers find difficult. In this work, we propose a behavior planning structure based on reinforcement learning (RL) which is capable of performing autonomous vehicle behavior planning with a hierarchical structure in simulated urban environments. Application of the hierarchical structure allows the various layers of the behavior planning system to be satisfied. Our algorithms can perform better than heuristic-rule-based methods for elective decisions such as when to turn left between vehicles approaching from the opposite direction or possible lane-change when approaching an intersection due to lane blockage or delay in front of the ego car. Such behavior is hard to evaluate as correct or incorrect, but for some aggressive expert human drivers handle such scenarios effectively and quickly. On the other hand, compared to traditional RL methods, our algorithm is more sample-efficient, due to the use of a hybrid reward mechanism and heuristic exploration during the training process. The results also show that the proposed method converges to an optimal policy faster than traditional RL methods.

📄 PDF Abstract BibTeX arXiv:2011.04697

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Cooperative Behavior Planning for Automated Driving using Graph Neural Networks

2022-02-23 · Marvin Klimke, Benjamin Völz, Michael Buchholz

Urban intersections are prone to delays and inefficiencies due to static precedence rules and occlusions limiting the view on prioritized traffic. Existing approaches to improve traffic flow, widely known as automatic in…

Decision Making Graph Neural Network Management

Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning

2025-04-07 · Songyang Liu, Muyang Fan, Weizi Li, Jing Du 외

Traffic congestion remains a significant challenge in modern urban networks. Autonomous driving technologies have emerged as a potential solution. Among traffic control methods, reinforcement learning has shown superior …

Autonomous Driving Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning

DSIP: A Dynamic Coordination Planner for Signal-Free Intersections using Diffusion-Model-Based Multi-Agent Motion Planning

2026-06-29 · Qian Hu, Haoyang Peng, Songan Zhang, Ming Yang 외 arxiv

Traffic signal control at urban intersections inherently introduces stop-and-go behavior, resulting in increased delays and reduced traffic efficiency, especially under high traffic demand. With the emergence of connecte…

Trajectory Planning Motion Planning

Domain Adaptation Framework for Turning Movement Count Estimation with Limited Data

2025-03-25 · Xiaobo Ma, Hyunsoo Noh, Ryan Hatch, James Tokishi 외

Urban transportation networks are vital for the efficient movement of people and goods, necessitating effective traffic management and planning. An integral part of traffic management is understanding the turning movemen…

Domain Adaptation Management Traffic Signal Control

Data-Driven Transfer Learning Framework for Estimating Turning Movement Counts

2024-12-13 · Xiaobo Ma, Hyunsoo Noh, Ryan Hatch, James Tokishi 외

Management Traffic Signal Control Transfer Learning