paper-with-me

홈 › Papers

FD-CAM: Improving Faithfulness and Discriminability of Visual Explanation for CNNs

2022-06-17 · Hui Li, Zihao Li, Rui Ma, Tieru Wu

Class activation map (CAM) has been widely studied for visual explanation of the internal working mechanism of convolutional neural networks. The key of existing CAM-based methods is to compute effective weights to combine activation maps in the target convolution layer. Existing gradient and score based weighting schemes have shown superiority in ensuring either the discriminability or faithfulness of the CAM, but they normally cannot excel in both properties. In this paper, we propose a novel CAM weighting scheme, named FD-CAM, to improve both the faithfulness and discriminability of the CAM-based CNN visual explanation. First, we improve the faithfulness and discriminability of the score-based weights by performing a grouped channel switching operation. Specifically, for each channel, we compute its similarity group and switch the group of channels on or off simultaneously to compute changes in the class prediction score as the weights. Then, we combine the improved score-based weights with the conventional gradient-based weights so that the discriminability of the final CAM can be further improved. We perform extensive comparisons with the state-of-the-art CAM algorithms. The quantitative and qualitative results show our FD-CAM can produce more faithful and more discriminative visual explanations of the CNNs. We also conduct experiments to verify the effectiveness of the proposed grouped channel switching and weight combination scheme on improving the results. Our code is available at https://github.com/crishhh1998/FD-CAM.

📄 PDF Abstract BibTeX arXiv:2206.08792

Code (1)

crishhh1998/fd-cam 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…

Similar Papers 제목 키워드 기반

A-FMI: Learning Attributions from Deep Networks via Feature Map Importance

2021-04-12 · An Zhang, Xiang Wang, Chengfang Fang, Jie Shi 외

Gradient-based attribution methods can aid in the understanding of convolutional neural networks (CNNs). However, the redundancy of attribution features and the gradient saturation problem, which weaken the ability to id…

UFO: A unified method for controlling Understandability and Faithfulness Objectives in concept-based explanations for CNNs

2023-03-27 · Vikram V. Ramaswamy, Sunnie S. Y. Kim, Ruth Fong, Olga Russakovsky

Concept-based explanations for convolutional neural networks (CNNs) aim to explain model behavior and outputs using a pre-defined set of semantic concepts (e.g., the model recognizes scene class ``bedroom'' based on the …

"Is your explanation stable?": A Robustness Evaluation Framework for Feature Attribution

2022-09-05 · Yuyou Gan, Yuhao Mao, Xuhong Zhang, Shouling Ji 외

Understanding the decision process of neural networks is hard. One vital method for explanation is to attribute its decision to pivotal features. Although many algorithms are proposed, most of them solely improve the fai…

AttributeSemantic Segmentation

On the Complexity-Faithfulness Trade-off of Gradient-Based Explanations

2025-08-14 · Amir Mehrpanah, Matteo Gamba, Kevin Smith, Hossein Azizpour arxiv

ReLU networks, while prevalent for visual data, have sharp transitions, sometimes relying on individual pixels for predictions, making vanilla gradient-based explanations noisy and difficult to interpret. Existing method…

Explanation-Driven Counterfactual Testing for Faithfulness in Vision-Language Model Explanations

2025-09-27 · Sihao Ding, Santosh Vasa, Aditi Ramadwar arxiv

Vision-Language Models (VLMs) often produce fluent Natural Language Explanations (NLEs) that sound convincing but may not reflect the causal factors driving predictions. This mismatch of plausibility and faithfulness pos…