paper-with-me

Papers

Evaluating Saliency Explanations in NLP by Crowdsourcing

2024-05-17 · Xiaotian Lu, Jiyi Li, Zhen Wan, Xiaofeng Lin, Koh Takeuchi, Hisashi Kashima

Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to explain models has become a key issue in the reliability of deep learning models in many important applications. Various saliency explanation methods, which give each feature of input a score proportional to the contribution of output, have been proposed to determine the part of the input which a model values most. Despite a considerable body of work on the evaluation of saliency methods, whether the results of various evaluation metrics agree with human cognition remains an open question. In this study, we propose a new human-based method to evaluate saliency methods in NLP by crowdsourcing. We recruited 800 crowd workers and empirically evaluated seven saliency methods on two datasets with the proposed method. We analyzed the performance of saliency methods, compared our results with existing automated evaluation methods, and identified notable differences between NLP and computer vision (CV) fields when using saliency methods. The instance-level data of our crowdsourced experiments and the code to reproduce the explanations are available at https://github.com/xtlu/lreccoling_evaluation.

📄 PDF Abstract BibTeX arXiv:2405.10767

Code (1)

xtlu/lreccoling_evaluation 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Interpretable Network Visualizations: A Human-in-the-Loop Approach for Post-hoc Explainability of CNN-based Image Classification

2024-05-06 · Matteo Bianchi, Antonio De Santis, Andrea Tocchetti, Marco Brambilla

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to s…

image-classificationImage ClassificationSentence

Easy to Decide, Hard to Agree: Reducing Disagreements Between Saliency Methods

2022-11-15 · Josip Jukić, Martin Tutek, Jan Šnajder

A popular approach to unveiling the black box of neural NLP models is to leverage saliency methods, which assign scalar importance scores to each input component. A common practice for evaluating whether an interpretabil…

Diagnostic

Guided AbsoluteGrad: Magnitude of Gradients Matters to Explanation's Localization and Saliency

2024-04-23 · Jun Huang, Yan Liu

This paper proposes a new gradient-based XAI method called Guided AbsoluteGrad for saliency map explanations. We utilize both positive and negative gradient magnitudes and employ gradient variance to distinguish the impo…

Evaluating the Faithfulness of Saliency-based Explanations for Deep Learning Models for Temporal Colour Constancy

2022-11-15 · Matteo Rizzo, Cristina Conati, Daesik Jang, Hui Hu

The opacity of deep learning models constrains their debugging and improvement. Augmenting deep models with saliency-based strategies, such as attention, has been claimed to help get a better understanding of the decisio…

Decision Making

SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches

2026-06-16 · Wencan Zhang, Mario Michelessa, Xuejun Zhao, Brian Y. Lim arxiv

Saliency map visualizations explain image-based AI predictions by pointing to regions, but these are often unintuitive and semantically unclear, leaving an interpretability gap. We argue that AI explanations should be in…