paper-with-me

홈 › Papers

Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Robotics

2026-06-02 · Xiaofei Wang, Mingliang Han, Tianyu Hao, Yi Yang, Yun-Bo Zhao, Keke Tang arxiv

Vision-language-action (VLA) models are gaining attention in robotics, yet their robustness to adversarial attacks remains largely unexplored. Existing work shows that adversarial patches can mislead VLA-based robots but assumes full access to the entire execution trajectory, an unrealistic requirement in practice. We address this limitation by formulating a partially observable threat model, where the adversary can exploit only a short prefix of the trajectory to generate a fixed patch applied to all subsequent frames. Under this setting, we propose a two-phase framework. First, we localize the patch using the model's attention maps to identify visually critical regions that correspond to the full instruction. Then, we optimize the patch to disrupt the semantic grounding of target objects and increase the curvature of action trajectories, thereby compounding failures in both perception and control. Extensive experiments in simulation and real-world robotic environments show that our method sustains adversarial effects under partial observability, inducing long-horizon disruptions and significantly reducing task success rates.

📄 PDF Abstract BibTeX arXiv:2606.03556

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Breaking the Illusion: Real-world Challenges for Adversarial Patches in Object Detection

2024-10-23 · Jakob Shack, Katarina Petrovic, Olga Saukh

Adversarial attacks pose a significant threat to the robustness and reliability of machine learning systems, particularly in computer vision applications. This study investigates the performance of adversarial patches fo…

object-detectionObject Detection

Minority Reports Defense: Defending Against Adversarial Patches

2020-04-28 · Michael McCoyd, Won Park, Steven Chen, Neil Shah 외

Deep learning image classification is vulnerable to adversarial attack, even if the attacker changes just a small patch of the image. We propose a defense against patch attacks based on partially occluding the image arou…

Adversarial AttackGeneral Classificationimage-classificationImage Classification

Random Position Adversarial Patch for Vision Transformers

2023-07-09 · Mingzhen Shao

Previous studies have shown the vulnerability of vision transformers to adversarial patches, but these studies all rely on a critical assumption: the attack patches must be perfectly aligned with the patches used for lin…

Position

Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey

2022-06-16 · Abhijith Sharma, Yijun Bian, Phil Munz, Apurva Narayan

Adversarial attacks in deep learning models, especially for safety-critical systems, are gaining more and more attention in recent years, due to the lack of trust in the security and robustness of AI models. Yet the more…

Certified Defenses for Adversarial Patches

2020-03-14 · ICLR 2020 1 · Ping-Yeh Chiang, Renkun Ni, Ahmed Abdelkader, Chen Zhu 외

Adversarial patch attacks are among one of the most practical threat models against real-world computer vision systems. This paper studies certified and empirical defenses against patch attacks. We begin with a set of ex…