paper-with-me

홈 › Papers

Off the Rails: Hijacking the Scoring Head in Generative End-to-End Driving Planners with Safety-Violating Adversarial Perturbations

2026-06-29 · Halima Bouzidi, Mboutidem Ekemini Mkpong, Haoyu Liu, Mohammad Abdullah Al Faruque arxiv

Generative models have recently seen rapid adoption in End-to-End (E2E) autonomous driving (AD), with diffusion-based denoising and vocabulary-based retrieval becoming the dominant trajectory-decoding paradigms. Despite their architectural diversity, current generative AD planners share a common inference pattern: a fixed set of candidate trajectories (anchors, vocabulary entries, or proposal queries) is scored by one or more learned heads conditioned on the Bird's-Eye-View (BEV) features, and the highest-scored candidate is returned as the final trajectory. Under this design, the scoring head is the only barrier between perception and the motion command, and its decision margins between competing candidates are often small. We introduce \textsc{Derail}, an adversarial framework that exploits this scoring-head attack surface. Evaluated on various generative planners, \textsc{Derail} flips the trajectory selection from a safe to an unsafe candidate, with score drops of $39$--$80\%$ and collision rates of up to $50\%$, consistently outperforming generic loss-maximization and feature-divergence attacks. Our analysis suggests that safety-violating objectives govern attack effectiveness against generative AD planners, and that the scoring-head inference pattern itself is a recurring attack surface worth explicit defensive consideration.

📄 PDF Abstract BibTeX arXiv:2606.30807

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

ShieldNet: Network-Level Guardrails against Emerging Supply-Chain Injections in Agentic Systems

2026-04-06 · Zhuowen Yuan, Zhaorun Chen, Zhen Xiang, Nathaniel D. Bastian 외 arxiv

Existing research on LLM agent security mainly focuses on prompt injection and unsafe input/output behaviors. However, as agents increasingly rely on third-party tools and MCP servers, a new class of supply-chain threats…

NiyamAI - An Intent-Bound AI Agent with Cryptographically Verifiable Guardrails using Zero-Knowledge Proofs

2026-08-07 · Aditya Katkar, Om Karkele, Kartik Mandhane, Manisha More 외 arxiv

Autonomous LLM agents with tool execution capabilities introduce severe security risks through prompt injection, goal hijacking, and unauthorized action invocation. Existing guardrails rely on unverified, host local soft…

Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination

2026-05-11 · Yangneng Chen, Junlin Li, Weijun Yao, Xilai Ma 외 arxiv

Large Vision-Language Models (LVLMs) have achieved remarkable progress in multimodal tasks, yet their reliability is persistently undermined by hallucinations-generating text that contradicts visual input. Recent studies…

Get a Model! Model Hijacking Attack Against Machine Learning Models

2021-11-08 · Ahmed Salem, Michael Backes, Yang Zhang

Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning m…

Autonomous DrivingBIG-bench Machine LearningData PoisoningDecoder+1

ControlLoc: Physical-World Hijacking Attack on Visual Perception in Autonomous Driving

2024-06-09 · Chen Ma, Ningfei Wang, Zhengyu Zhao, Qian Wang 외

Recent research in adversarial machine learning has focused on visual perception in Autonomous Driving (AD) and has shown that printed adversarial patches can attack object detectors. However, it is important to note tha…

Autonomous DrivingMultiple Object TrackingObjectobject-detection+2