Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff
The healthcare domain is one of the most exciting application areas for machine learning, but a lack of model transparency contributes to a lag in adoption within the industry. In this work, we explore the current art of explainability and interpretability within a case study in clinical text classification, using a task of mortality prediction within MIMIC-III clinical notes. We demonstrate various visualization techniques for fully interpretable methods as well as model-agnostic post hoc attributions, and we provide a generalized method for evaluating the quality of explanations using infidelity and local Lipschitz across model types from logistic regression to BERT variants. With these metrics, we introduce a framework through which practitioners and researchers can assess the frontier between a model's predictive performance and the quality of its available explanations. We make our code available to encourage continued refinement of these methods.
Code (1)
Tasks
Mortality Predictiontext-classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Mining Potentially Explanatory Patterns via Partial Solutions
Genetic Algorithms have established their capability for solving many complex optimization problems. Even as good solutions are produced, the user's understanding of a problem is not necessarily improved, which can lead …
Combinatorial OptimizationChallenges in Applying Explainability Methods to Improve the Fairness of NLP Models
Motivations for methods in explainable artificial intelligence (XAI) often include detecting, quantifying and mitigating bias, and contributing to making machine learning models fairer. However, exactly how an XAI method…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)FairnessQuantifying Explainable AI-introduced signal noise on ECG data with Spectral Entropy
Explainability techniques are used to assess the output of various deep learning models. This is especially true in healthcare, where models need to be trusted and decisions justified. Explainability (XAI) tools use heur…
Do Explanations Reflect Decisions? A Machine-centric Strategy to Quantify the Performance of Explainability Algorithms
There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm.…
Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)image-classification+1Stop ordering machine learning algorithms by their explainability! A user-centered investigation of performance and explainability
Machine learning algorithms enable advanced decision making in contemporary intelligent systems. Research indicates that there is a tradeoff between their model performance and explainability. Machine learning models wit…
BIG-bench Machine LearningDecision MakingExplainable artificial intelligence