Et Tu Certifications: Robustness Certificates Yield Better Adversarial Examples
In guaranteeing the absence of adversarial examples in an instance's neighbourhood, certification mechanisms play an important role in demonstrating neural net robustness. In this paper, we ask if these certifications can compromise the very models they help to protect? Our new \emph{Certification Aware Attack} exploits certifications to produce computationally efficient norm-minimising adversarial examples $74 \%$ more often than comparable attacks, while reducing the median perturbation norm by more than $10\%$. While these attacks can be used to assess the tightness of certification bounds, they also highlight that releasing certifications can paradoxically reduce security.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Double Bubble, Toil and Trouble: Enhancing Certified Robustness through Transitivity
In response to subtle adversarial examples flipping classifications of neural network models, recent research has promoted certified robustness as a solution. There, invariance of predictions to all norm-bounded attacks …
Open-Ended Question AnsweringAre Safety Guarantees in Neural Networks Safe? How to Compute Trustworthy Robustness Certifications
A primary challenge in AI safety is the existence of adversarial examples -- slightly distorted inputs that cause a neural network (NN) to misclassify. To mitigate this problem, recent research focuses on the computation…
$\ell_1$ Adversarial Robustness Certificates: a Randomized Smoothing Approach
Robustness is an important property to guarantee the security of machine learning models. It has recently been demonstrated that strong robustness certificates can be obtained on ensemble classifiers generated by input r…
Adversarial RobustnessCertified but Fooled! Breaking Certified Defences with Ghost Certificates
Certified defenses promise provable robustness guarantees. We study the malicious exploitation of probabilistic certification frameworks to better understand the limits of guarantee provisions. Now, the objective is to n…
Higher-Order Certified Robustness for Regression
Randomized smoothing has emerged as a scalable technique for certifying the adversarial robustness of classifiers. However, its application to regression remains under-explored and faces unique challenges. Existing regre…
Adversarial Robustness