paper-with-me

홈 › Papers

Driving with Style: Inverse Reinforcement Learning in General-Purpose Planning for Automated Driving

2019-05-01 · Sascha Rosbach, Vinit James, Simon Großjohann, Silviu Homoceanu, Stefan Roth

Behavior and motion planning play an important role in automated driving. Traditionally, behavior planners instruct local motion planners with predefined behaviors. Due to the high scene complexity in urban environments, unpredictable situations may occur in which behavior planners fail to match predefined behavior templates. Recently, general-purpose planners have been introduced, combining behavior and local motion planning. These general-purpose planners allow behavior-aware motion planning given a single reward function. However, two challenges arise: First, this function has to map a complex feature space into rewards. Second, the reward function has to be manually tuned by an expert. Manually tuning this reward function becomes a tedious task. In this paper, we propose an approach that relies on human driving demonstrations to automatically tune reward functions. This study offers important insights into the driving style optimization of general-purpose planners with maximum entropy inverse reinforcement learning. We evaluate our approach based on the expected value difference between learned and demonstrated policies. Furthermore, we compare the similarity of human driven trajectories with optimal policies of our planner under learned and expert-tuned reward functions. Our experiments show that we are able to learn reward functions exceeding the level of manual expert tuning without prior domain knowledge.

📄 PDF Abstract BibTeX arXiv:1905.00229

Code (0)

등록된 구현이 없습니다.

Tasks

Motion Planningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

Driving Style Encoder: Situational Reward Adaptation for General-Purpose Planning in Automated Driving

2019-12-07 · Sascha Rosbach, Vinit James, Simon Großjohann, Silviu Homoceanu 외

General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward function…

Model Predictive ControlMotion PlanningReinforcement Learning

Identifying Reaction-Aware Driving Styles of Stochastic Model Predictive Controlled Vehicles by Inverse Reinforcement Learning

2023-08-23 · Ni Dang, Tao Shi, Zengjie Zhang, Wanxin Jin 외

The driving style of an Autonomous Vehicle (AV) refers to how it behaves and interacts with other AVs. In a multi-vehicle autonomous driving system, an AV capable of identifying the driving styles of its nearby AVs can r…

Autonomous DrivingModel Predictive Control

Planning on the fast lane: Learning to interact using attention mechanisms in path integral inverse reinforcement learning

2020-07-11 · Sascha Rosbach, Xing Li, Simon Großjohann, Silviu Homoceanu 외

General-purpose trajectory planning algorithms for automated driving utilize complex reward functions to perform a combined optimization of strategic, behavioral, and kinematic features. The specification and tuning of a…

Trajectory Planning

HAD-Gen: Human-like and Diverse Driving Behavior Modeling for Controllable Scenario Generation

2025-03-19 · Cheng Wang, Lingxin Kong, Massimiliano Tamborski, Stefano V. Albrecht

Simulation-based testing has emerged as an essential tool for verifying and validating autonomous vehicles (AVs). However, contemporary methodologies, such as deterministic and imitation learning-based driver models, str…

Autonomous VehiclesImitation LearningMulti-agent Reinforcement Learningreinforcement-learning+1

Expressing Diverse Human Driving Behavior with Probabilistic Rewards and Online Inference

2020-08-20 · Liting Sun, Zheng Wu, Hengbo Ma, Masayoshi Tomizuka

In human-robot interaction (HRI) systems, such as autonomous vehicles, understanding and representing human behavior are important. Human behavior is naturally rich and diverse. Cost/reward learning, as an efficient way …

Autonomous VehiclesDiversity