paper-with-me

홈 › Papers

Jacobian Norm with Selective Input Gradient Regularization for Improved and Interpretable Adversarial Defense

2022-07-09 · Deyin Liu, Lin Wu, Haifeng Zhao, Farid Boussaid, Mohammed Bennamoun, Xianghua Xie

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples that are crafted with imperceptible perturbations, i.e., a small change in an input image can induce a mis-classification, and thus threatens the reliability of deep learning based deployment systems. Adversarial training (AT) is often adopted to improve robustness through training a mixture of corrupted and clean data. However, most of AT based methods are ineffective in dealing with transferred adversarial examples which are generated to fool a wide spectrum of defense models, and thus cannot satisfy the generalization requirement raised in real-world scenarios. Moreover, adversarially training a defense model in general cannot produce interpretable predictions towards the inputs with perturbations, whilst a highly interpretable robust model is required by different domain experts to understand the behaviour of a DNN. In this work, we propose a novel approach based on Jacobian norm and Selective Input Gradient Regularization (J-SIGR), which suggests the linearized robustness through Jacobian normalization and also regularizes the perturbation-based saliency maps to imitate the model's interpretable predictions. As such, we achieve both the improved defense and high interpretability of DNNs. Finally, we evaluate our method across different architectures against powerful adversarial attacks. Experiments demonstrate that the proposed J-SIGR confers improved robustness against transferred adversarial attacks, and we also show that the predictions from the neural network are easy to interpret.

📄 PDF Abstract BibTeX arXiv:2207.13036

Code (0)

등록된 구현이 없습니다.

Tasks

Adversarial Defense

Similar Papers 제목 키워드 기반

Gradient Regularization Improves Accuracy of Discriminative Models

2017-12-28 · Dániel Varga, Adrián Csiszárik, Zsolt Zombori

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that gradient regularization can consistently …

General Classification

Exact Spectral Norm Regularization for Neural Networks

2022-06-27 · Anton Johansson, Claes Strannegård, Niklas Engsner, Petter Mostad

We pursue a line of research that seeks to regularize the spectral norm of the Jacobian of the input-output mapping for deep neural networks. While previous work rely on upper bounding techniques, we provide a scheme tha…

Generalizing and Improving Jacobian and Hessian Regularization

2022-12-01 · Chenwei Cui, Zehao Yan, Guangshen Liu, Liangfu Lu

Jacobian and Hessian regularization aim to reduce the magnitude of the first and second-order partial derivatives with respect to neural network inputs, and they are predominantly used to ensure the adversarial robustnes…

Adversarial Robustness

Adversarially robust generalization theory via Jacobian regularization for deep neural networks

2024-12-17 · Dongya Wu, Xin Li

Powerful deep neural networks are vulnerable to adversarial attacks. To obtain adversarially robust models, researchers have separately developed adversarial training and Jacobian regularization techniques. There are abu…

Adversarial Attack

Nuclear Norm Regularization for Deep Learning

2024-05-23 · Christopher Scarvelis, Justin Solomon

Penalizing the nuclear norm of a function's Jacobian encourages it to locally behave like a low-rank linear map. Such functions vary locally along only a handful of directions, making the Jacobian nuclear norm a natural …

Deep LearningDenoisingRepresentation Learning