paper-with-me

Papers

Odysseus: Jailbreaking Commercial Multimodal LLM-integrated Systems via Dual Steganography

2025-12-23 · Songze Li, Jiameng Cheng, Yiming Li, Xiaojun Jia, Dacheng Tao arxiv

By integrating language understanding with perceptual modalities such as images, multimodal large language models (MLLMs) constitute a critical substrate for modern AI systems, particularly intelligent agents operating in open and interactive environments. However, their increasing accessibility also raises heightened risks of misuse, such as generating harmful or unsafe content. To mitigate these risks, alignment techniques are commonly applied to align model behavior with human values. Despite these efforts, recent studies have shown that jailbreak attacks can circumvent alignment and elicit unsafe outputs. Currently, most existing jailbreak methods are tailored for open-source models and exhibit limited effectiveness against commercial MLLM-integrated systems, which often employ additional filters. These filters can detect and prevent malicious input and output content, significantly reducing jailbreak threats. In this paper, we reveal that the success of these safety filters heavily relies on a critical assumption that malicious content must be explicitly visible in either the input or the output. This assumption, while often valid for traditional LLM-integrated systems, breaks down in MLLM-integrated systems, where attackers can leverage multiple modalities to conceal adversarial intent, leading to a false sense of security in existing MLLM-integrated systems. To challenge this assumption, we propose Odysseus, a novel jailbreak paradigm that introduces dual steganography to covertly embed malicious queries and responses into benign-looking images. Extensive experiments on benchmark datasets demonstrate that our Odysseus successfully jailbreaks several pioneering and realistic MLLM-integrated systems, achieving up to 99% attack success rate. It exposes a fundamental blind spot in existing defenses, and calls for rethinking cross-modal security in MLLM-integrated systems.

📄 PDF Abstract BibTeX arXiv:2512.20168

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Jailbreaking Large Vision Language Models in Intelligent Transportation Systems

2025-11-17 · Badhan Chandra Das, Md Tasnim Jawad, Md Jueal Mia, M. Hadi Amini 외 arxiv

Large Vision Language Models (LVLMs) demonstrate strong capabilities in multimodal reasoning and many real-world applications, such as visual question answering. However, LVLMs are highly vulnerable to jailbreaking attac…

Visual Question AnsweringMultimodal Reasoning

Automatic Jailbreaking of the Text-to-Image Generative AI Systems

2024-05-26 · Minseon Kim, Hyomin Lee, Boqing Gong, Huishuai Zhang 외

Recent AI systems have shown extremely powerful performance, even surpassing human performance, on various tasks such as information retrieval, language generation, and image generation based on large language models (LL…

Image GenerationInformation RetrievalMachine UnlearningText Generation

From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking

2024-06-21 · Siyuan Wang, Zhuohan Long, Zhihao Fan, Zhongyu Wei

The rapid development of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) has exposed vulnerabilities to various adversarial attacks. This paper provides a comprehensive overview of jailbreaking …

FENCE: A Financial and Multimodal Jailbreak Detection Dataset

2026-02-20 · Mirae Kim, Seonghun Jeong, Youngjun Kwak arxiv

Jailbreaking poses a significant risk to the deployment of Large Language Models (LLMs) and Vision Language Models (VLMs). VLMs are particularly vulnerable because they process both text and images, creating broader atta…

Multi-Agent Framework for Threat Mitigation and Resilience in AI-Based Systems

2025-12-29 · Armstrong Foundjem, Lionel Nganyewou Tidjon, Leuson Da Silva, Foutse Khomh arxiv

Machine learning (ML) underpins foundation models in finance, healthcare, and critical infrastructure, making them targets for data poisoning, model extraction, prompt injection, automated jailbreaking, and preference-gu…

Model extraction