paper-with-me

홈 › Papers

Efficient Indirect LLM Jailbreak via Multimodal-LLM Jailbreak

2024-05-30 · Zhenxing Niu, Yuyao Sun, Haoxuan Ji, Zheng Lin, Haichang Gao, Xinbo Gao, Gang Hua, Rong Jin

This paper focuses on jailbreaking attacks against large language models (LLMs), eliciting them to generate objectionable content in response to harmful user queries. Unlike previous LLM-jailbreak methods that directly orient to LLMs, our approach begins by constructing a multimodal large language model (MLLM) built upon the target LLM. Subsequently, we perform an efficient MLLM jailbreak and obtain a jailbreaking embedding. Finally, we convert the embedding into a textual jailbreaking suffix to carry out the jailbreak of target LLM. Compared to the direct LLM-jailbreak methods, our indirect jailbreaking approach is more efficient, as MLLMs are more vulnerable to jailbreak than pure LLM. Additionally, to improve the attack success rate of jailbreak, we propose an image-text semantic matching scheme to identify a suitable initial input. Extensive experiments demonstrate that our approach surpasses current state-of-the-art jailbreak methods in terms of both efficiency and effectiveness. Moreover, our approach exhibits superior cross-class generalization abilities.

📄 PDF Abstract BibTeX arXiv:2405.20015

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingLarge Language ModelLLM JailbreakMultimodal Large Language Model

Similar Papers 제목 키워드 기반

The Shawshank Redemption of Embodied AI: Understanding and Benchmarking Indirect Environmental Jailbreaks

2025-11-20 · Chunyang Li, Zifeng Kang, Junwei Zhang, Zhuo Ma 외 arxiv

The adoption of Vision-Language Models (VLMs) in embodied AI agents, while being effective, brings safety concerns such as jailbreaking. Prior work have explored the possibility of directly jailbreaking the embodied agen…

Poisoned LangChain: Jailbreak LLMs by LangChain

2024-06-26 · Ziqiu Wang, Jun Liu, Shengkai Zhang, Yang Yang

With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulner…

RAGRetrievalRetrieval-augmented Generation

Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues

2024-02-14 · Zhiyuan Chang, Mingyang Li, Yi Liu, Junjie Wang 외

With the development of LLMs, the security threats of LLMs are getting more and more attention. Numerous jailbreak attacks have been proposed to assess the security defense of LLMs. Current jailbreak attacks primarily ut…

Utilizing Jailbreak Probability to Attack and Safeguard Multimodal LLMs

2025-03-10 · Wenzhuo Xu, Zhipeng Wei, Xiongtao Sun, Deyue Zhang 외

Recently, Multimodal Large Language Models (MLLMs) have demonstrated their superior ability in understanding multimodal contents. However, they remain vulnerable to jailbreak attacks, which exploit weaknesses in their sa…

Binary ClassificationSafety Alignment

Test-Time Immunization: A Universal Defense Framework Against Jailbreaks for (Multimodal) Large Language Models

2025-05-28 · Yongcan Yu, Yanbo Wang, Ran He, Jian Liang

While (multimodal) large language models (LLMs) have attracted widespread attention due to their exceptional capabilities, they remain vulnerable to jailbreak attacks. Various defense methods are proposed to defend again…