paper-with-me

Papers

Evolving Jailbreaks: Automated Multi-Objective Long-Tail Attacks on Large Language Models

2026-03-20 · Wenjing Hong, Zhonghua Rong, Li Wang, Feng Chang, Jian Zhu, Ke Tang, Zexuan Zhu, Yew-Soon Ong arxiv

Large Language Models (LLMs) have been widely deployed, especially through free Web-based applications that expose them to diverse user-generated inputs, including those from long-tail distributions such as low-resource languages and encrypted private data. This open-ended exposure increases the risk of jailbreak attacks that undermine model safety alignment. While recent studies have shown that leveraging long-tail distributions can facilitate such jailbreaks, existing approaches largely rely on handcrafted rules, limiting the systematic evaluation of these security and privacy vulnerabilities. In this work, we present EvoJail, an automated framework for discovering long-tail distribution attacks via multi-objective evolutionary search. EvoJail formulates long-tail attack prompt generation as a multi-objective optimization problem that jointly maximizes attack effectiveness and minimizes output perplexity, and introduces a semantic-algorithmic solution representation to capture both high-level semantic intent and low-level structural transformations of encryption-decryption logic. Building upon this representation, EvoJail integrates LLM-assisted operators into a multi-objective evolutionary framework, enabling adaptive and semantically informed mutation and crossover for efficiently exploring a highly structured and open-ended search space. Extensive experiments demonstrate that EvoJail consistently discovers diverse and effective long-tail jailbreak strategies, achieving competitive performance with existing methods in both individual and ensemble level.

📄 PDF Abstract BibTeX arXiv:2603.20122

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

JailbreakSkill: Scaling Automated Red-Teaming with Reusable and Ever-Evolving Skills

2026-08-17 · Xiaoyu Wen, Jiajia Li, Zhida He, Peng Yu 외 arxiv

Automated red-teaming has produced a growing collection of attack strategies, yet they typically remain scattered across prompts and workflows, making them difficult to systematically integrate, reuse, and improve at sca…

LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet

2024-08-27 · Nathaniel Li, Ziwen Han, Ian Steneker, Willow Primack 외

Recent large language model (LLM) defenses have greatly improved models' ability to refuse harmful queries, even when adversarially attacked. However, LLM defenses are primarily evaluated against automated adversarial at…

Language ModelingLanguage ModellingLarge Language ModelMachine Unlearning+1

ObjexMT: Objective Extraction and Metacognitive Calibration for LLM-as-a-Judge under Multi-Turn Jailbreaks

2025-08-23 · Hyunjun Kim, Junwoo Ha, Sangyoon Yu, Haon Park arxiv

LLM-as-a-Judge (LLMaaJ) enables scalable evaluation, yet we lack a decisive test of a judge's qualification: can it recover the hidden objective of a conversation and know when that inference is reliable? Large language …

Semantic Similarity

Co-Evolutionary Multi-Modal Alignment via Structured Adversarial Evolution

2026-03-02 · Guoxin Shi, Haoyu Wang, Zaihui Yang, Yuxing Wang 외 arxiv

Adversarial behavior plays a central role in aligning large language models with human values. However, existing alignment methods largely rely on static adversarial settings, which fundamentally limit robustness, partic…

Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks

2025-02-28 · Hanjiang Hu, Alexander Robey, Changliu Liu

Large language models (LLMs) are highly vulnerable to jailbreaking attacks, wherein adversarial prompts are designed to elicit harmful responses. While existing defenses effectively mitigate single-turn attacks by detect…

Safety Alignment