paper-with-me

홈 › Papers

AED: Automatic Discovery of Effective and Diverse Vulnerabilities for Autonomous Driving Policy with Large Language Models

2025-03-24 · Le Qiu, Zelai Xu, Qixin Tan, Wenhao Tang, Chao Yu, Yu Wang

Assessing the safety of autonomous driving policy is of great importance, and reinforcement learning (RL) has emerged as a powerful method for discovering critical vulnerabilities in driving policies. However, existing RL-based approaches often struggle to identify vulnerabilities that are both effective-meaning the autonomous vehicle is genuinely responsible for the accidents-and diverse-meaning they span various failure types. To address these challenges, we propose AED, a framework that uses large language models (LLMs) to automatically discover effective and diverse vulnerabilities in autonomous driving policies. We first utilize an LLM to automatically design reward functions for RL training. Then we let the LLM consider a diverse set of accident types and train adversarial policies for different accident types in parallel. Finally, we use preference-based learning to filter ineffective accidents and enhance the effectiveness of each vulnerability. Experiments across multiple simulated traffic scenarios and tested policies show that AED uncovers a broader range of vulnerabilities and achieves higher attack success rates compared with expert-designed rewards, thereby reducing the need for manual reward engineering and improving the diversity and effectiveness of vulnerability discovery.

📄 PDF Abstract BibTeX arXiv:2503.20804

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

T-MAP: Red-Teaming LLM Agents with Trajectory-aware Evolutionary Search

2026-03-21 · Hyomin Lee, Sangwoo Park, Yumin Choi, Sohyun An 외 arxiv

While prior red-teaming efforts have focused on eliciting harmful text outputs from large language models (LLMs), such approaches fail to capture agent-specific vulnerabilities that emerge through multi-step tool executi…

Multi-Agent Vulnerability Discovery for Autonomous Driving with Hazard Arbitration Reward

2021-12-12 · Weilin Liu, Ye Mu, Chao Yu, Xuefei Ning 외

Discovering hazardous scenarios is crucial in testing and further improving driving policies. However, conducting efficient driving policy testing faces two key challenges. On the one hand, the probability of naturally e…

Autonomous DrivingMulti-agent Reinforcement Learning

TreeTeaming: Autonomous Red-Teaming of Vision-Language Models via Hierarchical Strategy Exploration

2026-03-24 · Chunxiao Li, Lijun Li, Jing Shao arxiv

The rapid advancement of Vision-Language Models (VLMs) has brought their safety vulnerabilities into sharp focus. However, existing red teaming methods are fundamentally constrained by an inherent linear exploration para…

Red Teaming

Dataforge: Agentic Platform for Autonomous Data Engineering

2025-11-09 · Xinyuan Wang, Hongyu Cao, Kunpeng Liu, Yanjie Fu arxiv

The growing demand for artificial intelligence (AI) applications in materials discovery, molecular modeling, and climate science has made data preparation a critical but labor-intensive bottleneck. Raw data from diverse …

RIFT-Bench: Dynamic Red-teaming For Agentic AI Systems

2026-06-22 · Yarin Yerushalmi Levi, Roy Betser, Amit Giloni, Lidor Erez 외 arxiv

Agentic AI systems powered by large language models (LLMs) are rapidly evolving into autonomous decision-making systems, exposing attack vectors beyond those of traditional LLM vulnerabilities. Existing security evaluati…