paper-with-me

홈 › Papers

On the Benefits of Models with Perceptually-Aligned Gradients

2020-05-04 · Gunjan Aggarwal, Abhishek Sinha, Nupur Kumari, Mayank Singh

Adversarial robust models have been shown to learn more robust and interpretable features than standard trained models. As shown in [\cite{tsipras2018robustness}], such robust models inherit useful interpretable properties where the gradient aligns perceptually well with images, and adding a large targeted adversarial perturbation leads to an image resembling the target class. We perform experiments to show that interpretable and perceptually aligned gradients are present even in models that do not show high robustness to adversarial attacks. Specifically, we perform adversarial training with attack for different max-perturbation bound. Adversarial training with low max-perturbation bound results in models that have interpretable features with only slight drop in performance over clean samples. In this paper, we leverage models with interpretable perceptually-aligned features and show that adversarial training with low max-perturbation bound can improve the performance of models for zero-shot and weakly supervised localization tasks.

📄 PDF Abstract BibTeX arXiv:2005.01499

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Are Perceptually-Aligned Gradients a General Property of Robust Classifiers?

2019-10-18 · Simran Kaur, Jeremy Cohen, Zachary C. Lipton

For a standard convolutional neural network, optimizing over the input pixels to maximize the score of some target class will generally produce a grainy-looking version of the original image. However, Santurkar et al. (2…

Adversarial Robustness

Adversarially robust segmentation models learn perceptually-aligned gradients

2022-04-03 · Pedro Sandoval-Segura

The effects of adversarial training on semantic segmentation networks has not been thoroughly explored. While previous work has shown that adversarially-trained image classifiers can be used to perform image synthesis, w…

Image GenerationImage InpaintingSegmentationSemantic Segmentation

Do Perceptually Aligned Gradients Imply Adversarial Robustness?

2022-07-22 · Roy Ganz, Bahjat Kawar, Michael Elad

Adversarially robust classifiers possess a trait that non-robust models do not -- Perceptually Aligned Gradients (PAG). Their gradients with respect to the input align well with human perception. Several works have ident…

Adversarial RobustnessImage Classification

Smooth Kernels Improve Adversarial Robustness and Perceptually-Aligned Gradients

2020-01-01 · ICLR 2020 1 · Haohan Wang, Xindi Wu, Songwei Ge, Zachary C. Lipton 외

Recent research has shown that CNNs are often overly sensitive to high-frequency textural patterns. Inspired by the intuition that humans are more sensitive to the lower-frequency (larger-scale) patterns we design a regu…

Adversarial Robustness

Which Models have Perceptually-Aligned Gradients? An Explanation via Off-Manifold Robustness

2023-05-30 · NeurIPS 2023 11 · Suraj Srinivas, Sebastian Bordt, Hima Lakkaraju

One of the remarkable properties of robust computer vision models is that their input-gradients are often aligned with human perception, referred to in the literature as perceptually-aligned gradients (PAGs). Despite onl…

DenoisingImage Generation