paper-with-me

홈 › Papers

Jailbreaking Frontier Foundation Models Through Intention Deception

2026-04-27 · Xinhe Wang, Katia Sycara, Yaqi Xie arxiv

Large (vision-)language models exhibit remarkable capability but remain highly susceptible to jailbreaking. Existing safety training approaches aim to have the model learn a refusal boundary between safe and unsafe, based on the user's intent. It has been found that this binary training regime often leads to brittleness, since the user intent cannot reliably be evaluated, especially if the attacker obfuscates their intent, and also makes the system seem unhelpful. In response, frontier models, such as GPT-5, have shifted from refusal-based safeguards to safe completion, that aims to maximize helpfulness while obeying safety constraints. However, safe completion could be exploited when a user pretends their intention is benign. Specifically, this intent inversion would be effective in multi-turn conversation, where the attacker has multiple opportunities to reinforce their deceptively benign intent. In this work, we introduce a novel multi-turn jailbreaking method that exploits this vulnerability. Our approach gradually builds conversational trust by simulating benign-seeming intentions and by exploiting the consistency property of the model, ultimately guiding the target model toward harmful, detailed outputs. Most crucially, our approach also uncovered an additional class of model vulnerability that we call para-jailbreaking that has been unnoticed up to now. Para-jailbreaking describes the situation where the model may not reveal harmful direct reply to the attack query, however the information that it reveals is nevertheless harmful. Our contributions are threefold. First, it achieves high success rates against frontier models including GPT-5-thinking and Claude-Sonnet-4.5. Second, our approach revealed and addressed para-jailbreaking harmful output. Third, experiments on multimodal VLM models showed that our approach outperformed state-of-the-art models.

📄 PDF Abstract BibTeX arXiv:2604.24082

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection

2026-06-17 · Jinhao Song, Shan Liang, Yiqun Yue, Zhuhuayang Zhang 외 arxiv

Multimodal deception detection is critical for identifying fraudulent intentions, yet existing approaches predominantly rely on end to end black--box paradigms. These methods suffer from a severe lack of interpretability…

Reinforcement LearningBinary Classification

Deception in Reinforced Autonomous Agents

2024-05-07 · Atharvan Dogra, Krishna Pillutla, Ameet Deshpande, Ananya B Sai 외

We explore the ability of large language model (LLM)-based agents to engage in subtle deception such as strategically phrasing and intentionally manipulating information to misguide and deceive other agents. This harmful…

Deception DetectionHallucinationLanguage ModelingLanguage Modelling+2

LH-Deception: Simulating and Understanding LLM Deceptive Behaviors in Long-Horizon Interactions

2025-10-05 · Yang Xu, Xuanming Zhang, Samuel Yeh, Jwala Dhamala 외 arxiv

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn p…

Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts

2025-08-08 · Zhaomin Wu, Mingzhe Du, See-Kiong Ng, Bingsheng He arxiv

Large Language Models (LLMs) are widely deployed in reasoning, planning, and decision-making tasks, making their trustworthiness critical. A significant and underexplored risk is intentional deception, where an LLM delib…

On Almost-Sure Intention Deception Planning that Exploits Imperfect Observers

2022-09-01 · Jie Fu

Intention deception involves computing a strategy which deceives the opponent into a wrong belief about the agent's intention or objective. This paper studies a class of probabilistic planning problems with intention dec…