paper-with-me

홈 › Papers

Cross-Generational Transfer of Adversarial Attacks Reveals Non-Monotonic Safety Alignment in LLMs

2026-05-30 · Subhadip Mitra arxiv

Safety alignment in LLMs does not improve monotonically across model generations. Studying four generations of Google's Gemma family (7B-31B) with quality-diversity evolution (MAP-Elites) as an automated red-teaming probe, we find that Gemma 3 (12B) exhibits 68.7% +/- 5.7% attack success rate (ASR; mean +/- std, 3 seeds), significantly higher than its predecessor Gemma 2 (45.5% +/- 7.2%; p = 0.030, paired bootstrap) and its successor Gemma 4 (33.9% +/- 1.8%). Replaying evolved attack archives across generations reveals that attacks from other generations transfer to Gemma 3 at 44-46% but only 14-18% to Gemma 4, indicating that Gemma 4's safety gains generalize beyond the attack distributions evolved against earlier generations. Under our 8B judge, copyright and cybercrime vulnerabilities register at near-100% across all generations, though a second-judge audit (Section 6) suggests the copyright result is sensitive to judge choice. Misinformation ASR jumps from 29% to 99% between Gemma 2 and Gemma 3 and remains elevated at 77% in Gemma 4, indicating the regression was not fully addressed. These patterns are invisible to static benchmarks and emerge only through adaptive, longitudinal probing. All experiments use 3 random seeds with a unified self-hosted judge; code and artifacts are available at https://github.com/bassrehab/red-queen.

📄 PDF Abstract BibTeX arXiv:2606.00813

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Cross-Model Transferability of Adversarial Patches in Real-time Segmentation for Autonomous Driving

2025-02-22 · Prashant Shekhar, Bidur Devkota, Dumindu Samaraweera, Laxima Niure Kandel 외

Adversarial attacks pose a significant threat to deep learning models, particularly in safety-critical applications like healthcare and autonomous driving. Recently, patch based attacks have demonstrated effectiveness in…

Autonomous DrivingAutonomous VehiclesSemantic Segmentation

Direction-Aggregated Attack for Transferable Adversarial Examples

2021-04-19 · Tianjin Huang, Vlado Menkovski, Yulong Pei, Yuhao Wang 외

Deep neural networks are vulnerable to adversarial examples that are crafted by imposing imperceptible changes to the inputs. However, these adversarial examples are most successful in white-box settings where the model …

Understanding and Enhancing the Transferability of Jailbreaking Attacks

2025-02-05 · Runqi Lin, Bo Han, Fengwang Li, Tongling Liu

Jailbreaking attacks can effectively manipulate open-source large language models (LLMs) to produce harmful responses. However, these attacks exhibit limited transferability, failing to disrupt proprietary LLMs consisten…

Intent RecognitionRed Teaming

Understanding Adversarial Transfer: Why Representation-Space Attacks Fail Where Data-Space Attacks Succeed

2025-10-01 · Isha Gupta, Rylan Schaeffer, Joshua Kazdan, Ken Ziyu Liu 외 arxiv

The field of adversarial robustness has long established that adversarial examples can successfully transfer between image classifiers and that text jailbreaks can successfully transfer between language models (LMs). How…

Adversarial Robustness

Evaluating the Adversarial Robustness of Detection Transformers

2024-12-25 · Amirhossein Nazeri, Chunheng Zhao, Pierluigi Pisu

Robust object detection is critical for autonomous driving and mobile robotics, where accurate detection of vehicles, pedestrians, and obstacles is essential for ensuring safety. Despite the advancements in object detect…

Adversarial RobustnessAutonomous DrivingObjectobject-detection+2