paper-with-me

홈 › Papers

Curvature-based Robustness Certificates against Adversarial Examples

2019-09-25 · Sahil Singla, Soheil Feizi

A robustness certificate against adversarial examples is the minimum distance of a given input to the decision boundary of the classifier (or its lower bound). For {\it any} perturbation of the input with a magnitude smaller than the certificate value, the classification output will provably remain unchanged. Computing exact robustness certificates for deep classifiers is difficult in general since it requires solving a non-convex optimization. In this paper, we provide computationally-efficient robustness certificates for deep classifiers with differentiable activation functions in two steps. First, we show that if the eigenvalues of the Hessian of the network (curvatures of the network) are bounded, we can compute a robustness certificate in the $l_2$ norm efficiently using convex optimization. Second, we derive a computationally-efficient differentiable upper bound on the curvature of a deep network. We also use the curvature bound as a regularization term during the training of the network to boost its certified robustness against adversarial examples. Putting these results together leads to our proposed {\bf C}urvature-based {\bf R}obustness {\bf C}ertificate (CRC) and {\bf C}urvature-based {\bf R}obust {\bf T}raining (CRT). Our numerical results show that CRC outperforms CROWN's certificate by an order of magnitude while CRT leads to higher certified accuracy compared to standard adversarial training and TRADES.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Compositional Curvature Bounds for Deep Neural Networks

2024-06-07 · Taha Entesari, Sina Sharifi, Mahyar Fazlyab

A key challenge that threatens the widespread use of neural networks in safety-critical applications is their vulnerability to adversarial attacks. In this paper, we study the second-order behavior of continuously differ…

Tight Second-Order Certificates for Randomized Smoothing

2020-10-20 · Alexander Levine, Aounon Kumar, Thomas Goldstein, Soheil Feizi

Randomized smoothing is a popular way of providing robustness guarantees against adversarial attacks: randomly-smoothed functions have a universal Lipschitz-like bound, allowing for robustness certificates to be easily c…

(De)Randomized Smoothing for Certifiable Defense against Patch Attacks

2020-02-25 · NeurIPS 2020 12 · Alexander Levine, Soheil Feizi

Patch adversarial attacks on images, in which the attacker can distort pixels within a region of bounded size, are an important threat model since they provide a quantitative model for physical adversarial attacks. In th…

Robustness against Adversarial Attacks in Neural Networks using Incremental Dissipativity

2021-11-25 · Bernardo Aquino, Arash Rahnama, Peter Seiler, Lizhen Lin 외

Adversarial examples can easily degrade the classification performance in neural networks. Empirical methods for promoting robustness to such examples have been proposed, but often lack both analytical insights and forma…

Robustness Certificates Against Adversarial Examples for ReLU Networks

2019-02-01 · Sahil Singla, Soheil Feizi

While neural networks have achieved high performance in different learning tasks, their accuracy drops significantly in the presence of small adversarial perturbations to inputs. Defenses based on regularization and adve…

General ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION