paper-with-me

Papers

TrailBlazer: History-Guided Reinforcement Learning for Black-Box LLM Jailbreaking

2026-02-06 · Sung-Hoon Yoon, Ruizhi Qian, Minda Zhao, Weiyue Li, Mengyu Wang arxiv

Large Language Models (LLMs) have become integral to many domains, making their safety a critical priority. Prior jailbreaking research has explored diverse approaches, including prompt optimization, automated red teaming, obfuscation, and reinforcement learning (RL) based methods. However, most existing techniques fail to effectively leverage vulnerabilities revealed in earlier interaction turns, resulting in inefficient and unstable attacks. Since jailbreaking involves sequential interactions in which each response influences future actions, reinforcement learning provides a natural framework for this problem. Motivated by this, we propose a history-aware RL-based jailbreak framework that analyzes and reweights vulnerability signals from prior steps to guide future decisions. We show that incorporating historical information alone improves jailbreak success rates. Building on this insight, we introduce an attention-based reweighting mechanism that highlights critical vulnerabilities within the interaction history, enabling more efficient exploration with fewer queries. Extensive experiments on AdvBench and HarmBench demonstrate that our method achieves state-of-the-art jailbreak performance while significantly improving query efficiency. These results underscore the importance of historical vulnerability signals in reinforcement learning-driven jailbreak strategies and offer a principled pathway for advancing adversarial research on LLM safeguards.

📄 PDF Abstract BibTeX arXiv:2602.06440

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningRed Teaming

Similar Papers 제목 키워드 기반

Fuzz-Testing Meets LLM-Based Agents: An Automated and Efficient Framework for Jailbreaking Text-To-Image Generation Models

2024-08-01 · Yingkai Dong, Xiangtao Meng, Ning Yu, Zheng Li 외

Text-to-image (T2I) generative models have revolutionized content creation by transforming textual descriptions into high-quality images. However, these models are vulnerable to jailbreaking attacks, where carefully craf…

Image GenerationIn-Context LearningLanguage ModellingLarge Language Model+2

xJailbreak: Representation Space Guided Reinforcement Learning for Interpretable LLM Jailbreaking

2025-01-28 · Sunbowen Lee, Shiwen Ni, Chi Wei, Shuaimin Li 외

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without ac…

Reinforcement Learning (RL)Safety Alignment

GPT-4 Jailbreaks Itself with Near-Perfect Success Using Self-Explanation

2024-05-21 · Govind Ramesh, Yao Dou, Wei Xu

Research on jailbreaking has been valuable for testing and understanding the safety and security issues of large language models (LLMs). In this paper, we introduce Iterative Refinement Induced Self-Jailbreak (IRIS), a n…

Jailbreaking to Jailbreak

2025-02-09 · Jeremy Kritz, Vaughn Robinson, Robert Vacareanu, Bijan Varjavand 외

Large Language Models (LLMs) can be used to red team other models (e.g. jailbreaking) to elicit harmful contents. While prior works commonly employ open-weight models or private uncensored models for doing jailbreaking, …

BitBypass: A New Direction in Jailbreaking Aligned Large Language Models with Bitstream Camouflage

2025-06-03 · Kalyan Nakka, Nitesh Saxena

The inherent risk of generating harmful and unsafe content by Large Language Models (LLMs), has highlighted the need for their safety alignment. Various techniques like supervised fine-tuning, reinforcement learning from…

Prompt EngineeringRed TeamingSafety Alignment