paper-with-me

Papers

Leveraging Local Structure for Improving Model Explanations: An Information Propagation Approach

2024-09-24 · Ruo Yang, Binghui Wang, Mustafa Bilgic

Numerous explanation methods have been recently developed to interpret the decisions made by deep neural network (DNN) models. For image classifiers, these methods typically provide an attribution score to each pixel in the image to quantify its contribution to the prediction. However, most of these explanation methods appropriate attribution scores to pixels independently, even though both humans and DNNs make decisions by analyzing a set of closely related pixels simultaneously. Hence, the attribution score of a pixel should be evaluated jointly by considering itself and its structurally-similar pixels. We propose a method called IProp, which models each pixel's individual attribution score as a source of explanatory information and explains the image prediction through the dynamic propagation of information across all pixels. To formulate the information propagation, IProp adopts the Markov Reward Process, which guarantees convergence, and the final status indicates the desired pixels' attribution scores. Furthermore, IProp is compatible with any existing attribution-based explanation method. Extensive experiments on various explanation methods and DNN models verify that IProp significantly improves them on a variety of interpretability metrics.

📄 PDF Abstract BibTeX arXiv:2409.16429

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Leveraging Structural Knowledge in Diffusion Models for Source Localization in Data-Limited Graph Scenarios

2025-02-25 · Hongyi Chen, Jingtao Ding, Xiaojun Liang, Yong Li 외

The source localization problem in graph information propagation is crucial for managing various network disruptions, from misinformation spread to infrastructure failures. While recent deep generative approaches have sh…

DenoisingMisinformation

Leveraging Latent Features for Local Explanations

2019-05-29 · Ronny Luss, Pin-Yu Chen, Amit Dhurandhar, Prasanna Sattigeri 외

As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot researc…

General ClassificationOpen-Ended Question AnsweringSelf-Driving Cars

XAI for Transformers: Better Explanations through Conservative Propagation

2022-02-15 · Ameen Ali, Thomas Schnake, Oliver Eberle, Grégoire Montavon 외

Transformers have become an important workhorse of machine learning, with numerous applications. This necessitates the development of reliable methods for increasing their transparency. Multiple interpretability methods,…

Explainable Artificial Intelligence (XAI)Question Answering

From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation

2022-06-07 · Reduan Achtibat, Maximilian Dreyer, Ilona Eisenbraun, Sebastian Bosse 외

The field of eXplainable Artificial Intelligence (XAI) aims to bring transparency to today's powerful but opaque deep learning models. While local XAI methods explain individual predictions in form of attribution maps, t…

Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Layer-wise Relevance Propagation for Explainable Recommendations

2018-07-17 · Homanga Bharadhwaj

In this paper, we tackle the problem of explanations in a deep-learning based model for recommendations by leveraging the technique of layer-wise relevance propagation. We use a Deep Convolutional Neural Network to extra…