paper-with-me

Papers

Expected Grad-CAM: Towards gradient faithfulness

2024-06-03 · Vincenzo Buono, Peyman Sheikholharam Mashhadi, Mahmoud Rahat, Prayag Tiwari, Stefan Byttner

Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation phenomena. Despite recent enhancements have incorporated counterfactual gradient strategies as a mitigating measure, these local explanation techniques still exhibit a lack of sensitivity to their baseline parameter. Our work proposes a gradient-weighted CAM augmentation that tackles both the saturation and sensitivity problem by reshaping the gradient computation, incorporating two well-established and provably approaches: Expected Gradients and kernel smoothing. By revisiting the original formulation as the smoothed expectation of the perturbed integrated gradients, one can concurrently construct more faithful, localized and robust explanations which minimize infidelity. Through fine modulation of the perturbation distribution it is possible to regulate the complexity characteristic of the explanation, selectively discriminating stable features. Our technique, Expected Grad-CAM, differently from recent works, exclusively optimizes the gradient computation, purposefully designed as an enhanced substitute of the foundational Grad-CAM algorithm and any method built therefrom. Quantitative and qualitative evaluations have been conducted to assess the effectiveness of our method.

📄 PDF Abstract BibTeX arXiv:2406.01274

Code (1)

espressoshock/pytorch-expected-gradcam 공식 구현 pytorch

Tasks

counterfactualSensitivity

Methods 이 논문이 사용한 방법론

CAM Class activation maps could be used to interpret the prediction decision made by the convolutional neural network (CNN). Image source: [Learning Deep Features for…

Similar Papers 제목 키워드 기반

Faithfulness Evaluation for Decoder-only LLM Attributions with Controlled Retained Information

2026-01-06 · Xin Huang, Antoni B. Chan arxiv

Large Language Models (LLMs) are increasingly evaluated with input attribution methods, yet comparing such explanations remains challenging. Existing soft-perturbation faithfulness metrics, such as Soft-NC and Soft-NS, c…

Rethinking Attention-Model Explainability through Faithfulness Violation Test

2022-01-28 · Yibing Liu, Haoliang Li, Yangyang Guo, Chenqi Kong 외

Attention mechanisms are dominating the explainability of deep models. They produce probability distributions over the input, which are widely deemed as feature-importance indicators. However, in this paper, we find one …

DiagnosticFeature Importancemodel

Towards a Theory of Faithfulness: Faithful Explanations of Differentiable Classifiers over Continuous Data

2022-05-19 · Nico Potyka, Xiang Yin, Francesca Toni

There is broad agreement in the literature that explanation methods should be faithful to the model that they explain, but faithfulness remains a rather vague term. We revisit faithfulness in the context of continuous da…

Joint learning of constraint weights and gradient inputs in Gradient Symbolic Computation with constrained optimization

2020-07-01 · WS 2020 7 · Max Nelson

This paper proposes a method for the joint optimization of constraint weights and symbol activations within the Gradient Symbolic Computation (GSC) framework. The set of grammars representable in GSC is proven to be a su…

On the Complexity-Faithfulness Trade-off of Gradient-Based Explanations

2025-08-14 · Amir Mehrpanah, Matteo Gamba, Kevin Smith, Hossein Azizpour arxiv

ReLU networks, while prevalent for visual data, have sharp transitions, sometimes relying on individual pixels for predictions, making vanilla gradient-based explanations noisy and difficult to interpret. Existing method…