paper-with-me

홈 › Papers

Do Perceptually Aligned Gradients Imply Adversarial Robustness?

2022-07-22 · Roy Ganz, Bahjat Kawar, Michael Elad

Adversarially robust classifiers possess a trait that non-robust models do not -- Perceptually Aligned Gradients (PAG). Their gradients with respect to the input align well with human perception. Several works have identified PAG as a byproduct of robust training, but none have considered it as a standalone phenomenon nor studied its own implications. In this work, we focus on this trait and test whether \emph{Perceptually Aligned Gradients imply Robustness}. To this end, we develop a novel objective to directly promote PAG in training classifiers and examine whether models with such gradients are more robust to adversarial attacks. Extensive experiments on multiple datasets and architectures validate that models with aligned gradients exhibit significant robustness, exposing the surprising bidirectional connection between PAG and robustness. Lastly, we show that better gradient alignment leads to increased robustness and harness this observation to boost the robustness of existing adversarial training techniques.

📄 PDF Abstract BibTeX arXiv:2207.11378

Code (1)

royg27/pag-rob 공식 구현 pytorch

Tasks

Adversarial RobustnessImage Classification

Methods 이 논문이 사용한 방법론

Test 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Are Perceptually-Aligned Gradients a General Property of Robust Classifiers?

2019-10-18 · Simran Kaur, Jeremy Cohen, Zachary C. Lipton

For a standard convolutional neural network, optimizing over the input pixels to maximize the score of some target class will generally produce a grainy-looking version of the original image. However, Santurkar et al. (2…

Adversarial Robustness

On the Benefits of Models with Perceptually-Aligned Gradients

2020-05-04 · Gunjan Aggarwal, Abhishek Sinha, Nupur Kumari, Mayank Singh

Adversarial robust models have been shown to learn more robust and interpretable features than standard trained models. As shown in [\cite{tsipras2018robustness}], such robust models inherit useful interpretable properti…

Smooth Kernels Improve Adversarial Robustness and Perceptually-Aligned Gradients

2020-01-01 · ICLR 2020 1 · Haohan Wang, Xindi Wu, Songwei Ge, Zachary C. Lipton 외

Recent research has shown that CNNs are often overly sensitive to high-frequency textural patterns. Inspired by the intuition that humans are more sensitive to the lower-frequency (larger-scale) patterns we design a regu…

Adversarial Robustness

Adversarially robust segmentation models learn perceptually-aligned gradients

2022-04-03 · Pedro Sandoval-Segura

The effects of adversarial training on semantic segmentation networks has not been thoroughly explored. While previous work has shown that adversarially-trained image classifiers can be used to perform image synthesis, w…

Image GenerationImage InpaintingSegmentationSemantic Segmentation

Which Models have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness

2023-05-30 · NeurIPS 2023 11 · Suraj Srinivas, Sebastian Bordt, Hima Lakkaraju

One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite onl…

DenoisingImage Generation