paper-with-me

홈 › Papers

Interpreting Predictions of NLP Models

2020-11-01 · EMNLP 2020 11 · Eric Wallace, Matt Gardner, Sameer Singh

Although neural NLP models are highly expressive and empirically successful, they also systematically fail in counterintuitive ways and are opaque in their decision-making process. This tutorial will provide a background on interpretation techniques, i.e., methods for explaining the predictions of NLP models. We will first situate example-specific interpretations in the context of other ways to understand models (e.g., probing, dataset analyses). Next, we will present a thorough study of example-specific interpretations, including saliency maps, input perturbations (e.g., LIME, input reduction), adversarial attacks, and influence functions. Alongside these descriptions, we will walk through source code that creates and visualizes interpretations for a diverse set of NLP tasks. Finally, we will discuss open problems in the field, e.g., evaluating, extending, and improving interpretation methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

LIME LIME, or Local Interpretable Model-Agnostic Explanations, is an algorithm that can explain the predictions of any classifier or regressor in a faithful way, by…

Similar Papers 제목 키워드 기반

Interpreting Graph Neural Networks for NLP With Differentiable Edge Masking

2020-10-01 · ICLR 2021 1 · Michael Sejr Schlichtkrull, Nicola De Cao, Ivan Titov

Graph neural networks (GNNs) have become a popular approach to integrating structural inductive biases into NLP models. However, there has been little work on interpreting them, and specifically on understanding which pa…

Question AnsweringSemantic Role Labeling

An unexpected unity among methods for interpreting model predictions

2016-11-22 · Scott Lundberg, Su-In Lee

Understanding why a model made a certain prediction is crucial in many data science fields. Interpretable predictions engender appropriate trust and provide insight into how the model may be improved. However, with large…

Unity

Methods for Interpreting and Understanding Deep Neural Networks

2017-06-24 · Grégoire Montavon, Wojciech Samek, Klaus-Robert Müller

This paper provides an entry point to the problem of interpreting a deep neural network model and explaining its predictions. It is based on a tutorial given at ICASSP 2017. It introduces some recently proposed technique…

Interpreting Differentiable Latent States for Healthcare Time-series Data

2023-11-29 · Yu Chen, Nivedita Bijlani, Samaneh Kouchaki, Payam Barnaghi

Machine learning enables extracting clinical insights from large temporal datasets. The applications of such machine learning models include identifying disease patterns and predicting patient outcomes. However, limited …

Predicting Patient OutcomesTime Series

Towards Explainable LiDAR Point Cloud Semantic Segmentation via Gradient Based Target Localization

2024-02-19 · Abhishek Kuriyal, Vaibhav Kumar

Semantic Segmentation (SS) of LiDAR point clouds is essential for many applications, such as urban planning and autonomous driving. While much progress has been made in interpreting SS predictions for images, interpretin…

Autonomous DrivingSemantic Segmentation