paper-with-me

홈 › Papers

Laundering AI Authority with Adversarial Examples

2026-05-05 · Jie Zhang, Pura Peetathawatchai, Florian Tramèr, Avital Shafran arxiv

Vision-language models (VLMs) are increasingly deployed as trusted authorities -- fact-checking images on social media, comparing products, and moderating content. Users implicitly trust that these systems perceive the same visual content as they do. We show that adversarial examples break this assumption, enabling \emph{AI authority laundering}: an attacker subtly perturbs an image so that the VLM produces confident and authoritative responses about the \emph{wrong} input. Unlike jailbreaks or prompt injections, our attacks do not compromise model alignment; the attack operates entirely at the perceptual level. We demonstrate that standard attacks against publicly available CLIP models transfer reliably to production VLMs -- including GPT-5.4, Claude Opus~4.6, Gemini~3, and Grok~4.2. Across four attack surfaces, we show that authority laundering can amplify misinformation, disparage individuals, evade content moderation, and manipulate product recommendations. Our attacks have high success rates: In hundreds of attacks targeting identity manipulation and NSFW evasion, we measure success rates of $22 - 100\%$ across six models. No novel attack algorithm is required: basic techniques known for over a decade suffice, establishing a lower bound on attacker capability that should concern defenders. Our results demonstrate that visual adversarial robustness is now a practical -- and still largely unsolved -- safety problem.

📄 PDF Abstract BibTeX arXiv:2605.04261

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Robustness

Similar Papers 제목 키워드 기반

Agent Memory Is a Surface for Endogenous Authorization Laundering

2026-09-01 · Tommaso Cerruti, Mika Okamoto, Ansel Kaplan Erol hf

Long-running LLM agents rely on persistent memory to carry state across interactions, including permissions, restrictions, and revocations. When memory misrepresents this evolving authorization state, the agent's own rec…

Intent Laundering: AI Safety Datasets Are Not What They Seem

2026-02-17 · Shahriar Golchin, Marc Wetter arxiv

We systematically evaluate the quality of widely used adversarial safety datasets from two perspectives: in isolation and in practice. In isolation, we examine how well these datasets reflect real-world adversarial attac…

When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents

2026-08-27 · Xiaokun Guo, Zhen Xu, Dongdong Huo, Yanqiu Zhang 외 arxiv

Tool-augmented LLM agents must rely on untrusted runtime Observations to complete open-ended tasks; however, when tool outputs no longer merely provide data but begin to specify concrete actions, they effectively become …

ChainCaps: Composition-Safe Tool-Using Agents via Monotonic Capability Attenuation

2026-05-26 · Xiaochong Jiang, Shiqi Yang, Ziwei Li, Lifei Liu 외 arxiv

Tool-using agents increasingly operate in open-ended deployment environments, where they compose file systems, web APIs, code interpreters, and enterprise services at runtime. This creates a safety gap in tool compositio…

Simulating and classifying behavior in adversarial environments based on action-state traces: an application to money laundering

2020-11-03 · Daniel Borrajo, Manuela Veloso, Sameena Shah

Many business applications involve adversarial relationships in which both sides adapt their strategies to optimize their opposing benefits. One of the key characteristics of these applications is the wide range of strat…