paper-with-me

홈 › Papers

Generating visual explanations from deep networks using implicit neural representations

2025-01-20 · Michal Byra, Henrik Skibbe

Explaining deep learning models in a way that humans can easily understand is essential for responsible artificial intelligence applications. Attribution methods constitute an important area of explainable deep learning. The attribution problem involves finding parts of the network's input that are the most responsible for the model's output. In this work, we demonstrate that implicit neural representations (INRs) constitute a good framework for generating visual explanations. Firstly, we utilize coordinate-based implicit networks to reformulate and extend the extremal perturbations technique and generate attribution masks. Experimental results confirm the usefulness of our method. For instance, by proper conditioning of the implicit network, we obtain attribution masks that are well-behaved with respect to the imposed area constraints. Secondly, we present an iterative INR-based method that can be used to generate multiple non-overlapping attribution masks for the same image. We depict that a deep learning model may associate the image label with both the appearance of the object of interest as well as with areas and textures usually accompanying the object. Our study demonstrates that implicit networks are well-suited for the generation of attribution masks and can provide interesting insights about the performance of deep learning models.

📄 PDF Abstract BibTeX arXiv:2501.11784

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learning

Similar Papers 제목 키워드 기반

Black-box Attacks on Image Activity Prediction and its Natural Language Explanations

2023-09-30 · Alina Elena Baia, Valentina Poggioni, Andrea Cavallaro

Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include text…

Activity PredictionActivity Recognition

Interpreting Vision and Language Generative Models with Semantic Visual Priors

2023-04-28 · Michele Cafagna, Lina M. Rojas-Barahona, Kees Van Deemter, Albert Gatt

When applied to Image-to-text models, interpretability methods often provide token-by-token explanations namely, they compute a visual explanation for each token of the generated sequence. Those explanations are expensiv…

Image to text

Knowledge-grounded Natural Language Recommendation Explanation

2023-08-30 · Anthony Colas, Jun Araki, Zhengyu Zhou, Bingqing Wang 외

Explanations accompanied by a recommendation can assist users in understanding the decision made by recommendation systems, which in turn increases a user's confidence and trust in the system. Recently, research has focu…

Collaborative FilteringExplainable RecommendationRecommendation Systems

Attribute-aware Explainable Complementary Clothing Recommendation

2021-07-04 · Yang Li, Tong Chen, Zi Huang

Modelling mix-and-match relationships among fashion items has become increasingly demanding yet challenging for modern E-commerce recommender systems. When performing clothes matching, most existing approaches leverage t…

AttributeRecommendation Systems

Local Universal Explainer (LUX) -- a rule-based explainer with factual, counterfactual and visual explanations

2023-10-23 · Szymon Bobek, Grzegorz J. Nalepa

Explainable artificial intelligence (XAI) is one of the most intensively developed area of AI in recent years. It is also one of the most fragmented with multiple methods that focus on different aspects of explanations. …

counterfactualExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Feature Importance