paper-with-me

Papers

Minimizing False-Positive Attributions in Explanations of Non-Linear Models

2025-05-16 · Anders Gjølbye, Stefan Haufe, Lars Kai Hansen

Suppressor variables can influence model predictions without being dependent on the target outcome and they pose a significant challenge for Explainable AI (XAI) methods. These variables may cause false-positive feature attributions, undermining the utility of explanations. Although effective remedies exist for linear models, their extension to non-linear models and to instance-based explanations has remained limited. We introduce PatternLocal, a novel XAI technique that addresses this gap. PatternLocal begins with a locally linear surrogate, e.g. LIME, KernelSHAP, or gradient-based methods, and transforms the resulting discriminative model weights into a generative representation, thereby suppressing the influence of suppressor variables while preserving local fidelity. In extensive hyperparameter optimization on the XAI-TRIS benchmark, PatternLocal consistently outperformed other XAI methods and reduced false-positive attributions when explaining non-linear tasks, thereby enabling more reliable and actionable insights.

📄 PDF Abstract BibTeX arXiv:2505.11210

Code (1)

gjoelbye/patternlocal 공식 구현

Tasks

Hyperparameter Optimization

Methods 이 논문이 사용한 방법론

LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

Efficient KernelSHAP Explanations for Patch-based 3D Medical Image Segmentation

2026-04-13 · Ricardo Coimbra Brioso, Giulio Sichili, Damiano Dei, Nicola Lambri 외 arxiv

Perturbation-based explainability methods such as KernelSHAP provide model-agnostic attributions but are typically impractical for patch-based 3D medical image segmentation due to the large number of coalition evaluation…

Medical Image Segmentation

Counterfactual Generation with Knockoffs

2021-02-01 · Oana-Iuliana Popescu, Maha Shadaydeh, Joachim Denzler

Human interpretability of deep neural networks' decisions is crucial, especially in domains where these directly affect human lives. Counterfactual explanations of already trained neural networks can be generated by pert…

counterfactualVariable Selection

TimeSHAP: Explaining Recurrent Models through Sequence Perturbations

2020-11-30 · João Bento, Pedro Saleiro, André F. Cruz, Mário A. T. Figueiredo 외

Although recurrent neural networks (RNNs) are state-of-the-art in numerous sequential decision-making tasks, there has been little research on explaining their predictions. In this work, we present TimeSHAP, a model-agno…

Decision MakingFeature ImportanceFraud DetectionSequential Decision Making+2

Attributing AUC-ROC to Analyze Binary Classifier Performance

2022-05-24 · Arya Tafvizi, Besim Avci, Mukund Sundararajan

Area Under the Receiver Operating Characteristic Curve (AUC-ROC) is a popular evaluation metric for binary classifiers. In this paper, we discuss techniques to segment the AUC-ROC along human-interpretable dimensions. AU…

XC: Exploring Quantitative Use Cases for Explanations in 3D Object Detection

2022-10-20 · Sunsheng Gu, Vahdat Abdelzad, Krzysztof Czarnecki

Explainable AI (XAI) methods are frequently applied to obtain qualitative insights about deep models' predictions. However, such insights need to be interpreted by a human observer to be useful. In this paper, we aim to …

3D Object DetectionExplainable Artificial Intelligence (XAI)object-detectionObject Detection