On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification
BERT, as one of the pretrianed language models, attracts the most attention in recent years for creating new benchmarks across GLUE tasks via fine-tuning. One pressing issue is to open up the blackbox and explain the decision makings of BERT. A number of attribution techniques have been proposed to explain BERT models, but are often limited to sequence to sequence tasks. In this paper, we adapt existing attribution methods on explaining decision makings of BERT in sequence classification tasks. We conduct extensive analyses of four existing attribution methods by applying them to four different datasets in sentiment analysis. We compare the reliability and robustness of each method via various ablation studies. Furthermore, we test whether attribution methods explain generalized semantics across semantically similar tasks. Our work provides solid guidance for using attribution methods to explain decision makings of BERT for downstream classification tasks.
Code (2)
Tasks
General ClassificationSentiment AnalysisMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
VQA-E: Explaining, Elaborating, and Enhancing Your Answers for Visual Questions
Most existing works in visual question answering (VQA) are dedicated to improving the accuracy of predicted answers, while disregarding the explanations. We argue that the explanation for an answer is of the same or even…
Explanatory Visual Question AnsweringMulti-Task LearningQuestion AnsweringVisual Question Answering+1Explaining Explanations in AI
Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teac…
BIG-bench Machine LearningPhilosophySociologyHow Can I Explain This to You? An Empirical Study of Deep Neural Network Explanation Methods
Explaining the inner workings of deep neural network models have received considerable attention in recent years. Researchers have attempted to provide human parseable explanations justifying why a model performed a spec…
General ClassificationSentiment AnalysisSentiment ClassificationEvaluating Post-hoc Explanations of the Transformer-based Genome Language Model DNABERT-2
Explaining deep neural network predictions on genome sequences enables biological insight and hypothesis generation-often of greater interest than predictive performance alone. While explanations of convolutional neural …
“Mama Always Had a Way of Explaining Things So I Could Understand”: A Dialogue Corpus for Learning to Construct Explanations
As AI is more and more pervasive in everyday life, humans have an increasing demand to understand its behavior and decisions. Most research on explainable AI builds on the premise that there is one ideal explanation to b…