paper-with-me

홈 › Papers

What Matters to Enhance Traffic Rule Compliance of Imitation Learning for End-to-End Autonomous Driving

2023-09-14 · Hongkuan Zhou, Wei Cao, Aifen Sui, Zhenshan Bing

End-to-end autonomous driving, where the entire driving pipeline is replaced with a single neural network, has recently gained research attention because of its simpler structure and faster inference time. Despite this appealing approach largely reducing the complexity in the driving pipeline, it also leads to safety issues because the trained policy is not always compliant with the traffic rules. In this paper, we proposed P-CSG, a penalty-based imitation learning approach with contrastive-based cross semantics generation sensor fusion technologies to increase the overall performance of end-to-end autonomous driving. In this method, we introduce three penalties - red light, stop sign, and curvature speed penalty to make the agent more sensitive to traffic rules. The proposed cross semantics generation helps to align the shared information of different input modalities. We assessed our model's performance using the CARLA Leaderboard - Town 05 Long Benchmark and Longest6 Benchmark, achieving 8.5% and 2.0% driving score improvement compared to the baselines. Furthermore, we conducted robustness evaluations against adversarial attacks like FGSM and Dot attacks, revealing a substantial increase in robustness compared to other baseline models. More detailed information can be found at https://hk-zh.github.io/p-csg-plus.

📄 PDF Abstract BibTeX arXiv:2309.07808

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingImitation LearningSensor Fusion

Methods 이 논문이 사용한 방법론

Entropy Regularization 설명 없음
PPO Proximal Policy Optimization, or PPO, is a policy gradient method for reinforcement learning. The motivation was to have an algorithm with the data efficiency and reliable…
CARLA CARLA is an open-source simulator for autonomous driving research. CARLA has been developed from the ground up to support development, training, and validation of autonomous urban…
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…
BASE 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Predictive Traffic Rule Compliance using Reinforcement Learning

2025-03-29 · Yanliang Huang, Sebastian Mair, Zhuoqi Zeng, Matthias Althoff

Autonomous vehicle path planning has reached a stage where safety and regulatory compliance are crucial. This paper presents an approach that integrates a motion planner with a deep reinforcement learning model to predic…

Deep Reinforcement LearningMotion Planningreinforcement-learningReinforcement Learning

Provable Traffic Rule Compliance in Safe Reinforcement Learning on the Open Sea

2024-02-13 · Hanna Krasowski, Matthias Althoff

For safe operation, autonomous vehicles have to obey traffic rules that are set forth in legal documents formulated in natural language. Temporal logic is a suitable concept to formalize such traffic rules. Still, tempor…

Autonomous VehiclesReinforcement Learning (RL)Safe Reinforcement Learning

Falsification-driven reinforcement learning for maritime motion planning

2025-10-08 · Marlon Müller, Florian Finkeldei, Hanna Krasowski, Murat Arcak 외 arxiv

Compliance with maritime traffic rules is essential for the safe operation of autonomous vessels, yet training reinforcement learning (RL) agents to adhere to them is challenging. The behavior of RL agents is shaped by t…

Reinforcement LearningMotion Planning

TR2MTL: LLM based framework for Metric Temporal Logic Formalization of Traffic Rules

2024-06-09 · Kumar Manas, Stefan Zwicklbauer, Adrian Paschke

Traffic rules formalization is crucial for verifying the compliance and safety of autonomous vehicles (AVs). However, manual translation of natural language traffic rules as formal specification requires domain knowledge…

Autonomous VehiclesIn-Context LearningTranslationvalid

RuleFuser: An Evidential Bayes Approach for Rule Injection in Imitation Learned Planners and Predictors for Robustness under Distribution Shifts

2024-05-18 · Jay Patrikar, Sushant Veer, Apoorva Sharma, Marco Pavone 외

Modern motion planners for autonomous driving frequently use imitation learning (IL) to draw from expert driving logs. Although IL benefits from its ability to glean nuanced and multi-modal human driving behaviors from l…

Autonomous DrivingImitation LearningTrajectory Prediction