Local Interpretations for Explainable Natural Language Processing: A Survey
As the use of deep learning techniques has grown across various fields over the past decade, complaints about the opaqueness of the black-box models have increased, resulting in an increased focus on transparency in deep learning models. This work investigates various methods to improve the interpretability of deep neural networks for Natural Language Processing (NLP) tasks, including machine translation and sentiment analysis. We provide a comprehensive discussion on the definition of the term interpretability and its various aspects at the beginning of this work. The methods collected and summarised in this survey are only associated with local interpretation and are specifically divided into three categories: 1) interpreting the model's predictions through related input features; 2) interpreting through natural language explanation; 3) probing the hidden states of models and word representations.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningMachine TranslationSentiment AnalysisSurveyTranslationSimilar Papers 제목 키워드 기반
Modeling language constructs with fuzzy sets: some approaches, examples and interpretations
We present and discuss a couple of approaches, including different types of projections, and some examples, discussing the use of fuzzy sets for modeling meaning of certain types of language constructs. We are mostly foc…
What can AI do for me: Evaluating Machine Learning Interpretations in Cooperative Play
Machine learning is an important tool for decision making, but its ethical and responsible application requires rigorous vetting of its interpretability and utility: an understudied problem, particularly for natural lang…
BIG-bench Machine LearningDecision MakingQuestion AnsweringFaithful and Accurate Self-Attention Attribution for Message Passing Neural Networks via the Computation Tree Viewpoint
The self-attention mechanism has been adopted in various popular message passing neural networks (MPNNs), enabling the model to adaptively control the amount of information that flows along the edges of the underlying gr…
Graph AttentionPerturbing Inputs for Fragile Interpretations in Deep Natural Language Processing
Interpretability methods like Integrated Gradient and LIME are popular choices for explaining natural language model predictions with relative word importance scores. These interpretations need to be robust for trustwort…
Language ModelingLanguage ModellingVariational Language Concepts for Interpreting Foundation Language Models
Foundation Language Models (FLMs) such as BERT and its variants have achieved remarkable success in natural language processing. To date, the interpretability of FLMs has primarily relied on the attention weights in thei…