paper-with-me

Papers

Jailbreaking Embodied LLMs via Action-level Manipulation

2026-03-02 · Xinyu Huang, Qiang Yang, Leming Shen, Zijing Ma, Yuanqing Zheng arxiv

Embodied Large Language Models (LLMs) enable AI agents to interact with the physical world through natural language instructions and actions. However, beyond the language-level risks inherent to LLMs themselves, embodied LLMs with real-world actuation introduce a new vulnerability: instructions that appear semantically benign may still lead to dangerous real-world consequences, revealing a fundamental misalignment between linguistic security and physical outcomes. In this paper, we introduce Blindfold, an automated attack framework that leverages the limited causal reasoning capabilities of embodied LLMs in real-world action contexts. Rather than iterative trial-and-error jailbreaking of black-box embodied LLMs, Blindfold adopts an Adversarial Proxy Planning strategy: it compromises a local surrogate LLM to perform action-level manipulations that appear semantically safe but could result in harmful physical effects when executed. Blindfold further conceals key malicious actions by injecting carefully crafted noise to evade detection by defense mechanisms, and it incorporates a rule-based verifier to improve the attack executability. Evaluations on both embodied AI simulators and a real-world 6DoF robotic arm show that Blindfold achieves up to 53% higher attack success rates than SOTA baselines, highlighting the urgent need to move beyond surface-level language censorship and toward consequence-aware defense mechanisms to secure embodied LLMs.

📄 PDF Abstract BibTeX arXiv:2603.01414

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

BadRobot: Jailbreaking Embodied LLMs in the Physical World

2024-07-16 · Hangtao Zhang, Chenyu Zhu, Xianlong Wang, Ziqi Zhou 외

Embodied AI represents systems where AI is integrated into physical entities. Large Language Model (LLM), which exhibits powerful language understanding abilities, has been extensively employed in embodied AI by facilita…

Language ModelingLanguage ModellingLarge Language ModelTask Planning

EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents

2025-02-13 · Rui Yang, Hanyang Chen, Junyu Zhang, Mark Zhao 외

Leveraging Multi-modal Large Language Models (MLLMs) to create embodied agents offers a promising avenue for tackling real-world tasks. While language-centric embodied agents have garnered substantial attention, MLLM-bas…

Benchmarking

Lockpicking LLMs: A Logit-Based Jailbreak Using Token-level Manipulation

2024-05-20 · Yuxi Li, Yi Liu, Yuekang Li, Ling Shi 외

Large language models (LLMs) have transformed the field of natural language processing, but they remain susceptible to jailbreaking attacks that exploit their capabilities to generate unintended and potentially harmful c…

AttnGCG: Enhancing Jailbreaking Attacks on LLMs with Attention Manipulation

2024-10-11 · Zijun Wang, Haoqin Tu, Jieru Mei, Bingchen Zhao 외

This paper studies the vulnerabilities of transformer-based Large Language Models (LLMs) to jailbreaking attacks, focusing specifically on the optimization-based Greedy Coordinate Gradient (GCG) strategy. We first observ…

Safety Alignment

EMMOE: A Comprehensive Benchmark for Embodied Mobile Manipulation in Open Environments

2025-03-11 · Dongping Li, Tielong Cai, Tianci Tang, Wenhao Chai 외

Developing autonomous home robots controlled by natural language has long been a pursuit of humanity. While advancements in large language models (LLMs) and embodied intelligence make this goal closer, several challenges…