paper-with-me

홈 › Papers

Certified Multi-Turn Robustness for LLM Safety via Compositional Bounds and Safety Persistence

2026-08-21 · Yang Liu, Bin Chong, Wenkai Yang, Shuai Zhang, Yancheng Chen, Feiyu Han, GuoZhen, Cheng Zhang, Huaibing Xie, Changze Lv, Shihan Dou, Pluto Zhou arxiv

Large language models (LLMs) are vulnerable to multi-turn jailbreak attacks that progressively manipulate conversation context. Existing certified robustness methods are limited to single-turn inputs; naive multi-turn composition yields bounds that degrade exponentially in the number of turns. We introduce Multi-Turn Certified Robustness (MTCR), a framework that models conversational safety via State-Adversarial MDPs and defines $k$-turn certified robustness as the worst-case safety probability across $k$ adversarial turns. MTCR comprises: (i) compositional certification via embedding-space mode decomposition, yielding tighter certified lower bounds than naive multiplication; (ii) $(α,β)$-safety persistence, improving the degradation rate from $\underline{p}^{k}$ to $β^k$ (with $β> \underline{p}$) and yielding interpretable horizon estimates; (iii) matching information-theoretic upper bounds establishing tightness; and (iv) a unified algorithm combining these results. Experiments on six LLMs under $ε$-bounded and Crescendo-style attacks confirm that empirical safety consistently exceeds the certified bounds.

📄 PDF Abstract BibTeX arXiv:2608.20820

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Boosting Certified Robustness of Deep Networks via a Compositional Architecture

2021-01-01 · ICLR 2021 1 · Mark Niklas Mueller, Mislav Balunovic, Martin Vechev

A core challenge with existing certified defense mechanisms is that while they improve certified robustness, they also tend to drastically decrease standard accuracy, making it difficult to use these methods in practice.…

Safety as Computation: Certified Answer Reuse via Capability Closure in Task-Oriented Dialogue

2026-03-22 · Cosimo Spera arxiv

We introduce a new paradigm for task-oriented dialogue systems: safety certification as a computational primitive for answer reuse. Current systems treat each turn independently, recomputing answers via retrieval or gene…

Task-Oriented Dialogue Systems

On the Extreme Variance of Certified Local Robustness Across Model Seeds

2026-01-19 · Minh Le, Phuong Cao arxiv

Robustness verification of neural networks, referring to formally proving that neural networks satisfy robustness properties, is of crucial importance in safety-critical applications, where model failures can result in l…

CAMP in the Odyssey: Provably Robust Reinforcement Learning with Certified Radius Maximization

2025-01-29 · Derui Wang, Kristen Moore, Diksha Goel, Minjune Kim 외

Deep reinforcement learning (DRL) has gained widespread adoption in control and decision-making tasks due to its strong performance in dynamic environments. However, DRL agents are vulnerable to noisy observations and ad…

Adversarial RobustnessDeep Reinforcement Learning

CaRT: Certified Safety and Robust Tracking in Learning-based Motion Planning for Multi-Agent Systems

2023-07-13 · Hiroyasu Tsukamoto, Benjamin Rivière, Changrak Choi, Amir Rahmani 외

The key innovation of our analytical method, CaRT, lies in establishing a new hierarchical, distributed architecture to guarantee the safety and robustness of a given learning-based motion planning policy. First, in a no…

Motion Planning