paper-with-me

홈 › Papers

VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking

2026-05-27 · Jiyuan Fu, Kaixun Jiang, Jingkai Jia, Zhaoyu Chen, Xueyao Chen, Lingyi Hong, Shuyong Gao, Chenzhi Tan, Dingkang Yang, Wenqiang Zhang arxiv

While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in safety-critical domains. Moreover, existing patch attacks primarily focus on white-box settings, heavily overfitting to the specific action output space of the target model, which results in poor cross-architecture transferability. To overcome this limitation, we propose VLA-Hijack, a unified adversarial framework that breaks the transferability bottleneck by exploiting a fundamental vulnerability identified in this work: before planning any motion, a VLA model must first use visual information to locate its own robotic arm within the environment. Targeting this shared visual self-localization process, our approach concurrently optimizes Attention-Guided Proprioceptive Suppression to inhibit the real robotic arm's features, and Multimodal Proprioceptive Injection to establish the patch as a surrogate "phantom embodiment". By alternating between semantic concept anchoring and visual prototype projection, VLA-Hijack effectively severs the semantic relationship between the agent's true embodiment and its control policy. Extensive experiments across diverse architectures (OpenVLA, UniVLA, and CronusVLA) demonstrate that VLA-Hijack achieves superior optimization efficiency in white-box settings and sets a new SOTA for cross-architecture and cross-domain black-box transferability.

📄 PDF Abstract BibTeX arXiv:2605.28083

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models

2025-11-26 · Hui Lu, Yi Yu, Yiming Yang, Chenyu Yi 외 arxiv

Vision-Language-Action (VLA) models are vulnerable to adversarial attacks, yet universal and transferable attacks remain underexplored, as most existing patches overfit to a single model and fail in black-box settings. T…

Structure-Aware Robust Fine-Tuning: Defending Vision-Language-Action Robots Against Physical Attention Hijacking

2026-08-04 · Jinquan Zhang, Dongfu Yin, Run Yang, Yufeng Yan 외 arxiv

Vision-Language-Action (VLA) policies promise general robotic manipulation, but their robustness against physical-world attacks remains fragile. In particular, we show that physically realizable adversarial patches can r…

HijackRAG: Hijacking Attacks against Retrieval-Augmented Large Language Models

2024-10-30 · Yucheng Zhang, Qinfeng Li, Tianyu Du, Xuhong Zhang 외

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge, making them adaptable and cost-effective for various applications. However, the growing reliance on the…

RAGRetrievalRetrieval-augmented Generation

Get a Model! Model Hijacking Attack Against Machine Learning Models

2021-11-08 · Ahmed Salem, Michael Backes, Yang Zhang

Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning m…

Autonomous DrivingBIG-bench Machine LearningData PoisoningDecoder+1

TRAP: Hijacking VLA CoT-Reasoning via Adversarial Patches

2026-03-24 · Zhengxian Huang, Wenjun Zhu, Haoxuan Qiu, Xiaoyu Ji 외 arxiv

By integrating Chain-of-Thought (CoT) reasoning, Vision-Language-Action (VLA) models have demonstrated strong capabilities in robotic manipulation, particularly by improving generalization and interpretability. However, …

Adversarial Attack