Certified Multi-Turn Robustness for LLM Safety via Compositional Bounds and Safety Persistence
Large language models (LLMs) are vulnerable to multi-turn jailbreak attacks that progressively manipulate conversation context. Existing certified robustness methods are limited to single-turn inputs; naive multi-turn composition yields bounds that degrade exponentially in the number of turns. We introduce Multi-Turn Certified Robustness (MTCR), a framework that models conversational safety via State-Adversarial MDPs and defines $k$-turn certified robustness as the worst-case safety probability across $k$ adversarial turns. MTCR comprises: (i) compositional certification via embedding-space mode decomposition, yielding tighter certified lower bounds than naive multiplication; (ii) $(α,β)$-safety persistence, improving the degradation rate from $\underline{p}^{k}$ to $β^k$ (with $β> \underline{p}$) and yielding interpretable horizon estimates; (iii) matching information-theoretic upper bounds establishing tightness; and (iv) a unified algorithm combining these results. Experiments on six LLMs under $ε$-bounded and Crescendo-style attacks confirm that empirical safety consistently exceeds the certified bounds.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Boosting Certified Robustness of Deep Networks via a Compositional Architecture
A core challenge with existing certified defense mechanisms is that while they improve certified robustness, they also tend to drastically decrease standard accuracy, making it difficult to use these methods in practice.…
Safety as Computation: Certified Answer Reuse via Capability Closure in Task-Oriented Dialogue
We introduce a new paradigm for task-oriented dialogue systems: safety certification as a computational primitive for answer reuse. Current systems treat each turn independently, recomputing answers via retrieval or gene…
Task-Oriented Dialogue SystemsOn the Extreme Variance of Certified Local Robustness Across Model Seeds
Robustness verification of neural networks, referring to formally proving that neural networks satisfy robustness properties, is of crucial importance in safety-critical applications, where model failures can result in l…
CAMP in the Odyssey: Provably Robust Reinforcement Learning with Certified Radius Maximization
Deep reinforcement learning (DRL) has gained widespread adoption in control and decision-making tasks due to its strong performance in dynamic environments. However, DRL agents are vulnerable to noisy observations and ad…
Adversarial RobustnessDeep Reinforcement LearningCaRT: Certified Safety and Robust Tracking in Learning-based Motion Planning for Multi-Agent Systems
The key innovation of our analytical method, CaRT, lies in establishing a new hierarchical, distributed architecture to guarantee the safety and robustness of a given learning-based motion planning policy. First, in a no…
Motion Planning