paper-with-me

Papers

Adversarial Counterfactual Visual Explanations

2023-03-17 · CVPR 2023 1 · Guillaume Jeanneret, Loïc Simon, Frédéric Jurie

Counterfactual explanations and adversarial attacks have a related goal: flipping output labels with minimal perturbations regardless of their characteristics. Yet, adversarial attacks cannot be used directly in a counterfactual explanation perspective, as such perturbations are perceived as noise and not as actionable and understandable image modifications. Building on the robust learning literature, this paper proposes an elegant method to turn adversarial attacks into semantically meaningful perturbations, without modifying the classifiers to explain. The proposed approach hypothesizes that Denoising Diffusion Probabilistic Models are excellent regularizers for avoiding high-frequency and out-of-distribution perturbations when generating adversarial attacks. The paper's key idea is to build attacks through a diffusion model to polish them. This allows studying the target model regardless of its robustification level. Extensive experimentation shows the advantages of our counterfactual explanation approach over current State-of-the-Art in multiple testbeds.

📄 PDF Abstract BibTeX arXiv:2303.09962

Code (1)

guillaumejs2403/ace 공식 구현 pytorch

Tasks

counterfactualCounterfactual ExplanationDenoising

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Counterfactual Explanations for Face Forgery Detection via Adversarial Removal of Artifacts

2024-04-12 · Yang Li, Songlin Yang, Wei Wang, Ziwen He 외

Highly realistic AI generated face forgeries known as deepfakes have raised serious social concerns. Although DNN-based face forgery detection models have achieved good performance, they are vulnerable to latest generati…

Adversarial Attackcounterfactual

Counterfactual Visual Explanation via Causally-Guided Adversarial Steering

2025-07-14 · Yiran Qiao, Disheng Liu, Yiren Lu, Yu Yin 외 arxiv

Recent work on counterfactual visual explanations has contributed to making artificial intelligence models more explainable by providing visual perturbation to flip the prediction. However, these approaches neglect the c…

Image Generation

Exploring Counterfactual Explanations Through the Lens of Adversarial Examples: A Theoretical and Empirical Analysis

2021-06-18 · Martin Pawelczyk, Chirag Agarwal, Shalmali Joshi, Sohini Upadhyay 외

As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing …

counterfactualCounterfactual Explanation

GANterfactual-RL: Understanding Reinforcement Learning Agents' Strategies through Visual Counterfactual Explanations

2023-02-24 · Tobias Huber, Maximilian Demmler, Silvan Mertes, Matthew L. Olson 외

Counterfactual explanations are a common tool to explain artificial intelligence models. For Reinforcement Learning (RL) agents, they answer "Why not?" or "What if?" questions by illustrating what minimal change to a sta…

counterfactualDecision Makingreinforcement-learningReinforcement Learning (RL)

Diffusion Visual Counterfactual Explanations

2022-10-21 · Maximilian Augustin, Valentyn Boreiko, Francesco Croce, Matthias Hein

Visual Counterfactual Explanations (VCEs) are an important tool to understand the decisions of an image classifier. They are 'small' but 'realistic' semantic changes of the image changing the classifier decision. Current…

counterfactualimage-classificationImage Classification