paper-with-me

Papers

DriveDPO: Policy Learning via Safety DPO For End-to-End Autonomous Driving

2025-09-22 · Shuyao Shang, Yuntao Chen, Yuqi Wang, Yingyan Li, Zhaoxiang Zhang arxiv

End-to-end autonomous driving has substantially progressed by directly predicting future trajectories from raw perception inputs, which bypasses traditional modular pipelines. However, mainstream methods trained via imitation learning suffer from critical safety limitations, as they fail to distinguish between trajectories that appear human-like but are potentially unsafe. Some recent approaches attempt to address this by regressing multiple rule-driven scores but decoupling supervision from policy optimization, resulting in suboptimal performance. To tackle these challenges, we propose DriveDPO, a Safety Direct Preference Optimization Policy Learning framework. First, we distill a unified policy distribution from human imitation similarity and rule-based safety scores for direct policy optimization. Further, we introduce an iterative Direct Preference Optimization stage formulated as trajectory-level preference alignment. Extensive experiments on the NAVSIM benchmark demonstrate that DriveDPO achieves a new state-of-the-art PDMS of 90.0. Furthermore, qualitative results across diverse challenging scenarios highlight DriveDPO's ability to produce safer and more reliable driving behaviors.

📄 PDF Abstract BibTeX arXiv:2509.17940

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

Rationale-aware Autonomous Driving Policy utilizing Safety Force Field implemented on CARLA Simulator

2022-11-18 · Ho Suk, Taewoo Kim, Hyungbin Park, Pamul Yadav 외

Despite the rapid improvement of autonomous driving technology in recent years, automotive manufacturers must resolve liability issues to commercialize autonomous passenger car of SAE J3016 Level 3 or higher. To cope wit…

Autonomous Driving

VL-SAFE: Vision-Language Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Driving

2025-05-22 · Yansong Qu, Zilin Huang, Zihao Sheng, Jiancong Chen 외

Reinforcement learning (RL)-based autonomous driving policy learning faces critical limitations such as low sample efficiency and poor generalization; its reliance on online interactions and trial-and-error learning is e…

Autonomous DrivingReinforcement Learning (RL)

Driving in Corner Case: A Real-World Adversarial Closed-Loop Evaluation Platform for End-to-End Autonomous Driving

2025-12-18 · Jiaheng Geng, Jiatong Du, Xinyu Zhang, Ye Li 외 arxiv

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases…

Autonomous Driving

Learning Safe Autonomous Driving Policies Using Predictive Safety Representations

2025-12-19 · Mahesh Keswani, Raunak Bhattacharyya arxiv

Safe reinforcement learning (SafeRL) is a prominent paradigm for autonomous driving, where agents are required to optimize performance under strict safety requirements. This dual objective creates a fundamental tension, …

Reinforcement LearningAutonomous Driving

World Engine: Towards the Era of Post-Training for Autonomous Driving

2026-06-18 · Tianyu Li, Li Chen, Caojun Wang, Haochen Liu 외 arxiv

Autonomous vehicles must operate safely in the real world, where errors can have severe consequences. Although modern end-to-end driving policies excel in routine scenarios, their reliability is limited by the scarcity o…

Autonomous VehiclesAutonomous Driving