Developing Driving Strategies Efficiently: A Skill-Based Hierarchical Reinforcement Learning Approach

2023-02-04 · Yigit Gurses, Kaan Buyukdemirci, Yildiray Yildiz

Driving in dense traffic with human and autonomous drivers is a challenging task that requires high-level planning and reasoning. Human drivers can achieve this task comfortably, and there has been many efforts to model human driver strategies. These strategies can be used as inspirations for developing autonomous driving algorithms or to create high-fidelity simulators. Reinforcement learning is a common tool to model driver policies, but conventional training of these models can be computationally expensive and time-consuming. To address this issue, in this paper, we propose ``skill-based" hierarchical driving strategies, where motion primitives, i.e. skills, are designed and used as high-level actions. This reduces the training time for applications that require multiple models with varying behavior. Simulation results in a merging scenario demonstrate that the proposed approach yields driver models that achieve higher performance with less training compared to baseline reinforcement learning methods.

📄 PDF Abstract BibTeX arXiv:2302.02179

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MRSD: Multi-Resolution Skill Discovery for HRL Agents

2025-05-27 · Shashank Sharma, Janina Hoffmann, Vinay Namboodiri

Hierarchical reinforcement learning (HRL) relies on abstract skills to solve long-horizon tasks efficiently. While existing skill discovery methods learns these skills automatically, they are limited to a single skill pe…

Hierarchical Reinforcement Learning

Disentangled Unsupervised Skill Discovery for Efficient Hierarchical Reinforcement Learning

2024-10-15 · Jiaheng Hu, Zizhao Wang, Peter Stone, Roberto Martín-Martín

A hallmark of intelligent agents is the ability to learn reusable skills purely from unsupervised interaction with the environment. However, existing unsupervised skill discovery methods often learn entangled skills wher…

Disentanglement Hierarchical Reinforcement Learning reinforcement-learning Reinforcement Learning

Extensive Exploration in Complex Traffic Scenarios using Hierarchical Reinforcement Learning

2025-01-25 · Zhihao Zhang, Ekim Yurtsever, Keith A. Redmill

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based co…

Decision Making Deep Reinforcement Learning Hierarchical Reinforcement Learning reinforcement-learning+1

Boosting Offline Reinforcement Learning for Autonomous Driving with Hierarchical Latent Skills

2023-09-24 · Zenan Li, Fan Nie, Qiao Sun, Fang Da 외

Learning-based vehicle planning is receiving increasing attention with the emergence of diverse driving simulators and large-scale driving datasets. While offline reinforcement learning (RL) is well suited for these safe…

Autonomous Driving Offline RL reinforcement-learning Reinforcement Learning (RL)

A Deep Hierarchical Approach to Lifelong Learning in Minecraft

2016-04-25 · Chen Tessler, Shahar Givony, Tom Zahavy, Daniel J. Mankowitz 외

We propose a lifelong learning system that has the ability to reuse and transfer knowledge from one task to another while efficiently retaining the previously learned knowledge-base. Knowledge is transferred by learning …

Deep Reinforcement Learning Lifelong learning Minecraft Reinforcement Learning