paper-with-me

홈 › Papers

Boosting Jailbreak Transferability for Large Language Models

2024-10-21 · Hanqing Liu, Lifeng Zhou, Huanqian Yan

Large language models have drawn significant attention to the challenge of safe alignment, especially regarding jailbreak attacks that circumvent security measures to produce harmful content. To address the limitations of existing methods like GCG, which perform well in single-model attacks but lack transferability, we propose several enhancements, including a scenario induction template, optimized suffix selection, and the integration of re-suffix attack mechanism to reduce inconsistent outputs. Our approach has shown superior performance in extensive experiments across various benchmarks, achieving nearly 100% success rates in both attack execution and transferability. Notably, our method has won the first place in the AISG-hosted Global Challenge for Safe and Secure LLMs. The code is released at https://github.com/HqingLiu/SI-GCG.

📄 PDF Abstract BibTeX arXiv:2410.15645

Code (1)

HqingLiu/SI-GCG 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Guiding not Forcing: Enhancing the Transferability of Jailbreaking Attacks on LLMs via Removing Superfluous Constraints

2025-02-25 · Junxiao Yang, Zhexin Zhang, Shiyao Cui, Hongning Wang 외

Jailbreaking attacks can effectively induce unsafe behaviors in Large Language Models (LLMs); however, the transferability of these attacks across different models remains limited. This study aims to understand and enhan…

LLM-Virus: Evolutionary Jailbreak Attack on Large Language Models

2024-12-28 · Miao Yu, Junfeng Fang, Yingjie Zhou, Xing Fan 외

While safety-aligned large language models (LLMs) are increasingly used as the cornerstone for powerful systems such as multi-agent frameworks to solve complex real-world problems, they still suffer from potential advers…

Heuristic SearchTransfer Learning

Jailbreaking Attack against Multimodal Large Language Model

2024-02-04 · Zhenxing Niu, Haodong Ren, Xinbo Gao, Gang Hua 외

This paper focuses on jailbreaking attacks against multi-modal large language models (MLLMs), seeking to elicit MLLMs to generate objectionable responses to harmful user queries. A maximum likelihood-based algorithm is p…

Language ModelingLanguage ModellingLarge Language Modelmodel+1

Exploring and Developing a Pre-Model Safeguard with Draft Models

2026-05-19 · Hongyu Cai, Arjun Arunasalam, Yiming Liang, Antonio Bianchi 외 arxiv

Large Language Model (LLM) alignment remains vulnerable to jailbreak attacks that elicit unsafe responses, motivating pre-model and post-model guards. Pre-model guards audit the safety of prompts before invoking target m…

Distract Large Language Models for Automatic Jailbreak Attack

2024-03-13 · Zeguan Xiao, Yan Yang, Guanhua Chen, Yun Chen

Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations …

Red Teaming