paper-with-me

Papers

Explanation-based Training with Differentiable Insertion/Deletion Metric-aware Regularizers

2023-10-19 · Yuya Yoshikawa, Tomoharu Iwata

The quality of explanations for the predictions made by complex machine learning predictors is often measured using insertion and deletion metrics, which assess the faithfulness of the explanations, i.e., how accurately the explanations reflect the predictor's behavior. To improve the faithfulness, we propose insertion/deletion metric-aware explanation-based optimization (ID-ExpO), which optimizes differentiable predictors to improve both the insertion and deletion scores of the explanations while maintaining their predictive accuracy. Because the original insertion and deletion metrics are non-differentiable with respect to the explanations and directly unavailable for gradient-based optimization, we extend the metrics so that they are differentiable and use them to formalize insertion and deletion metric-based regularizers. Our experimental results on image and tabular datasets show that the deep neural network-based predictors that are fine-tuned using ID-ExpO enable popular post-hoc explainers to produce more faithful and easier-to-interpret explanations while maintaining high predictive accuracy. The code is available at https://github.com/yuyay/idexpo.

📄 PDF Abstract BibTeX arXiv:2310.12553

Code (1)

yuyay/idexpo 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Beyond Output Faithfulness: Learning Attributions that Preserve Computational Pathways

2025-09-04 · Siyu Zhang, Kenneth Mcmillan arxiv

Faithfulness metrics such as insertion and deletion evaluate how feature removal affects model outputs but overlook whether explanations preserve the computational pathway the network actually uses. We show that external…

Insertion-Deletion Transformer

2020-01-15 · Laura Ruis, Mitchell Stern, Julia Proskurnia, William Chan

We propose the Insertion-Deletion Transformer, a novel transformer-based neural architecture and training method for sequence generation. The model consists of two phases that are executed iteratively, 1) an insertion ph…

Translation

Learn to Rank: Visual Attribution by Learning Importance Ranking

2026-04-07 · David Schinagl, Christian Fruhwirth-Reisinger, Alexander Prutsch, Samuel Schulter 외 arxiv

Interpreting the decisions of complex computer vision models is crucial to establish trust and accountability, especially in safety-critical domains. An established approach to interpretability is generating visual attri…

Neural Edit Operations for Biological Sequences

2018-12-01 · NeurIPS 2018 12 · Satoshi Koide, Keisuke Kawano, Takuro Kutsuna

The evolution of biological sequences, such as proteins or DNAs, is driven by the three basic edit operations: substitution, insertion, and deletion. Motivated by the recent progress of neural network models for biologic…

Protein Secondary Structure Prediction

Mean Opinion Score as a New Metric for User-Evaluation of XAI Methods

2024-07-29 · Hyeon Yu, Jenny Benois-Pineau, Romain Bourqui, Romain Giot 외

This paper investigates the use of Mean Opinion Score (MOS), a common image quality metric, as a user-centric evaluation metric for XAI post-hoc explainers. To measure the MOS, a user experiment is proposed, which has be…