paper-with-me

홈 › Papers

FuncPoison: Poisoning Function Library to Hijack Multi-agent Autonomous Driving Systems

2025-09-29 · Yuzhen Long, Songze Li arxiv

Autonomous driving systems increasingly rely on multi-agent architectures powered by large language models (LLMs), where specialized agents collaborate to perceive, reason, and plan. A key component of these systems is the shared function library, a collection of software tools that agents use to process sensor data and navigate complex driving environments. Despite its critical role in agent decision-making, the function library remains an under-explored vulnerability. In this paper, we introduce FuncPoison, a novel poisoning-based attack targeting the function library to manipulate the behavior of LLM-driven multi-agent autonomous systems. FuncPoison exploits two key weaknesses in how agents access the function library: (1) agents rely on text-based instructions to select tools; and (2) these tools are activated using standardized command formats that attackers can replicate. By injecting malicious tools with deceptive instructions, FuncPoison manipulates one agent s decisions--such as misinterpreting road conditions--triggering cascading errors that mislead other agents in the system. We experimentally evaluate FuncPoison on two representative multi-agent autonomous driving systems, demonstrating its ability to significantly degrade trajectory accuracy, flexibly target specific agents to induce coordinated misbehavior, and evade diverse defense mechanisms. Our results reveal that the function library, often considered a simple toolset, can serve as a critical attack surface in LLM-based autonomous driving systems, raising elevated concerns on their reliability.

📄 PDF Abstract BibTeX arXiv:2509.24408

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Driving

Similar Papers 제목 키워드 기반

Get a Model! Model Hijacking Attack Against Machine Learning Models

2021-11-08 · Ahmed Salem, Michael Backes, Yang Zhang

Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning m…

Autonomous DrivingBIG-bench Machine LearningData PoisoningDecoder+1

Model Hijacking Attack in Federated Learning

2024-08-04 · Zheng Li, Siyuan Wu, Ruichuan Chen, Paarijaat Aditya 외

Machine learning (ML), driven by prominent paradigms such as centralized and federated learning, has made significant progress in various critical applications ranging from autonomous driving to face recognition. However…

Autonomous DrivingData PoisoningFace RecognitionFederated Learning+1

RouteGuard: Internal-Signal Detection of Skill Poisoning in LLM Agents

2026-04-24 · Wenjie Xiao, Xuehai Tang, Biyu Zhou, Songlin Hu 외 arxiv

Agent skills introduce a new and more severe form of indirect injection for LLM agents: unlike traditional indirect prompt injection, attackers can hide malicious instructions inside a dense, action-oriented skill that a…

A Failure-Mode Benchmark for Polymorphic Sybil Poisoning in RAG

2026-07-04 · Donghyun Lee, Juntae Kim arxiv

We release a benchmark and failure-mode-aware evaluation framework for grounded QA under coordinated retrieval poisoning. The framework partitions reader outputs into four mutually exclusive categories (\emph{gold}, \emp…

SilentRetrieval: Hijacking Retrieval-Augmented Generation via Semantically-Preserving Adversarial Data Poisoning

2026-05-27 · Jiachen Qian arxiv

Retrieval-Augmented Generation (RAG) mitigates LLM hallucinations but introduces a critical vulnerability: corpus integrity. We present SilentRetrieval, a two-stage data poisoning attack that hijacks RAG systems through …

Natural Questions