paper-with-me

Papers

Evaluating Post-hoc Interpretability with Intrinsic Interpretability

2023-05-04 · José Pereira Amorim, Pedro Henriques Abreu, João Santos, Henning Müller

Despite Convolutional Neural Networks having reached human-level performance in some medical tasks, their clinical use has been hindered by their lack of interpretability. Two major interpretability strategies have been proposed to tackle this problem: post-hoc methods and intrinsic methods. Although there are several post-hoc methods to interpret DL models, there is significant variation between the explanations provided by each method, and it a difficult to validate them due to the lack of ground-truth. To address this challenge, we adapted the intrinsical interpretable ProtoPNet for the context of histopathology imaging and compared the attribution maps produced by it and the saliency maps made by post-hoc methods. To evaluate the similarity between saliency map methods and attribution maps we adapted 10 saliency metrics from the saliency model literature, and used the breast cancer metastases detection dataset PatchCamelyon with 327,680 patches of histopathological images of sentinel lymph node sections to validate the proposed approach. Overall, SmoothGrad and Occlusion were found to have a statistically bigger overlap with ProtoPNet while Deconvolution and Lime have been found to have the least.

📄 PDF Abstract BibTeX arXiv:2305.03002

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

Towards Intrinsic Interpretability of Large Language Models:A Survey of Design Principles and Architectures

2026-04-17 · Yutong Gao, Qinglin Meng, Yuan Zhou, Liangming Pan arxiv

While Large Language Models (LLMs) have achieved strong performance across many NLP tasks, their opaque internal mechanisms hinder trustworthiness and safe deployment. Existing surveys in explainable AI largely focus on …

A Method for Evaluating the Interpretability of Machine Learning Models in Predicting Bond Default Risk Based on LIME and SHAP

2025-02-26 · Yan Zhang, Lin Chen, Yixiang Tian

Interpretability analysis methods for artificial intelligence models, such as LIME and SHAP, are widely used, though they primarily serve as post-model for analyzing model outputs. While it is commonly believed that the …

Prediction

The Model Organism Lottery: Model Organism Interpretability Strongly Depends on Training Methodology

2026-07-01 · Andrzej Szablewski, Gabriel Konar-Steenberg, Raffaello Fornasiere, Nikita Menon 외 arxiv

Model organisms (MOs) - language models trained to exhibit undesired or unnatural behaviours - are frequently used as testbeds for evaluating white-box interpretability techniques. Current MOs are typically constructed v…

Fidelity of Interpretability Methods and Perturbation Artifacts in Neural Networks

2022-03-06 · Lennart Brocki, Neo Christopher Chung

Despite excellent performance of deep neural networks (DNNs) in image classification, detection, and prediction, characterizing how DNNs make a given decision remains an open problem, resulting in a number of interpretab…

image-classificationImage Classification

DIDER: Discovering Interpretable Dynamically Evolving Relations

2022-08-22 · Enna Sachdeva, Chiho Choi

Effective understanding of dynamically evolving multiagent interactions is crucial to capturing the underlying behavior of agents in social systems. It is usually challenging to observe these interactions directly, and t…

PredictionTrajectory Forecasting