Jailbreaking with Universal Multi-Prompts
Large language models (LLMs) have seen rapid development in recent years, revolutionizing various applications and significantly enhancing convenience and productivity. However, alongside their impressive capabilities, ethical concerns and new types of attacks, such as jailbreaking, have emerged. While most prompting techniques focus on optimizing adversarial inputs for individual cases, resulting in higher computational costs when dealing with large datasets. Less research has addressed the more general setting of training a universal attacker that can transfer to unseen tasks. In this paper, we introduce JUMP, a prompt-based method designed to jailbreak LLMs using universal multi-prompts. We also adapt our approach for defense, which we term DUMP. Experimental results demonstrate that our method for optimizing universal multi-prompts outperforms existing techniques.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Jailbreaking Attack against Multimodal Large Language Model
This paper focuses on jailbreaking attacks against multi-modal large language models (MLLMs), seeking to elicit MLLMs to generate objectionable responses to harmful user queries. A maximum likelihood-based algorithm is p…
Language ModelingLanguage ModellingLarge Language Modelmodel+1AutoBreach: Universal and Adaptive Jailbreaking with Efficient Wordplay-Guided Optimization
Despite the widespread application of large language models (LLMs) across various tasks, recent studies indicate that they are susceptible to jailbreak attacks, which can render their defense mechanisms ineffective. Howe…
SentenceSentence CompressionJailbreaking GPT-4V via Self-Adversarial Attacks with System Prompts
Existing work on jailbreak Multimodal Large Language Models (MLLMs) has focused primarily on adversarial examples in model inputs, with less attention to vulnerabilities, especially in model API. To fill the research gap…
Adversarial AttackRed TeamingFoot In The Door: Understanding Large Language Model Jailbreaking via Cognitive Psychology
Large Language Models (LLMs) have gradually become the gateway for people to acquire new knowledge. However, attackers can break the model's security protection ("jail") to access restricted information, which is called …
Decision MakingLanguage ModelingLanguage ModellingLarge Language ModelAutomatic Jailbreaking of the Text-to-Image Generative AI Systems
Recent AI systems have shown extremely powerful performance, even surpassing human performance, on various tasks such as information retrieval, language generation, and image generation based on large language models (LL…
Image GenerationInformation RetrievalMachine UnlearningText Generation