paper-with-me

Papers

GAMBIT: A Gamified Jailbreak Framework for Multimodal Large Language Models

2026-01-06 · Xiangdong Hu, Yangyang Jiang, Qin Hu, Xiaojun Jia arxiv

Multimodal Large Language Models (MLLMs) have become widely deployed, yet their safety alignment remains fragile under adversarial inputs. Previous work has shown that increasing inference steps can disrupt safety mechanisms and lead MLLMs to generate attacker-desired harmful content. However, most existing attacks focus on increasing the complexity of the modified visual task itself and do not explicitly leverage the model's own reasoning incentives. This leads to them underperforming on reasoning models (Models with Chain-of-Thoughts) compared to non-reasoning ones (Models without Chain-of-Thoughts). If a model can think like a human, can we influence its cognitive-stage decisions so that it proactively completes a jailbreak? To validate this idea, we propose GAMBI} (Gamified Adversarial Multimodal Breakout via Instructional Traps), a novel multimodal jailbreak framework that decomposes and reassembles harmful visual semantics, then constructs a gamified scene that drives the model to explore, reconstruct intent, and answer as part of winning the game. The resulting structured reasoning chain increases task complexity in both vision and text, positioning the model as a participant whose goal pursuit reduces safety attention and induces it to answer the reconstructed malicious query. Extensive experiments on popular reasoning and non-reasoning MLLMs demonstrate that GAMBIT achieves high Attack Success Rates (ASR), reaching 92.13% on Gemini 2.5 Flash, 91.20% on QvQ-MAX, and 85.87% on GPT-4o, significantly outperforming baselines.

📄 PDF Abstract BibTeX arXiv:2601.03416

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Gambits: Theory and Evidence

2021-10-05 · Shiva Maharaj, Nicholas Polson, Christian Turk

Gambits are central to human decision-making. Our goal is to provide a theory of Gambits. A Gambit is a combination of psychological and technical factors designed to disrupt predictable play. Chess provides an environme…

Decision MakingSequential Decision Making

Gamified crowd-sourcing of high-quality data for visual fine-tuning

2024-10-05 · Shashank Yadav, Rohan Tomar, Garvit Jain, Chirag Ahooja 외

This paper introduces Gamified Adversarial Prompting (GAP), a framework that crowd-sources high-quality data for visual instruction tuning of large multimodal models. GAP transforms the data collection process into an en…

Visual Question Answering

Test-Time Immunization: A Universal Defense Framework Against Jailbreaks for (Multimodal) Large Language Models

2025-05-28 · Yongcan Yu, Yanbo Wang, Ran He, Jian Liang

While (multimodal) large language models (LLMs) have attracted widespread attention due to their exceptional capabilities, they remain vulnerable to jailbreak attacks. Various defense methods are proposed to defend again…

DMN: A Compositional Framework for Jailbreaking Multimodal LLMs with Multi-Image Inputs

2026-05-18 · Wenzhuo Xu, Zhipeng Wei, Zonghao Ying, Deyue Zhang 외 arxiv

Multimodal Large Language Models (MLLMs) are vulnerable to jailbreak attacks, which can elicit harmful responses from MLLMs. Many MLLMs support multi-image inputs, inadvertently introducing new vulnerabilities due to les…

Visual Reasoning

On Optimizing Multimodal Jailbreaks for Spoken Language Models

2026-03-19 · Aravind Krishnan, Karolina Stańczak, Dietrich Klakow arxiv

As Spoken Language Models (SLMs) integrate speech and text modalities, they inherit the safety vulnerabilities of their LLM backbone while introducing an expanded attack surface. SLMs have been previously shown to be sus…