paper-with-me

Papers

Explaining Black-box Models for Biomedical Text Classification

2020-12-20 · Milad Moradi, Matthias Samwald

In this paper, we propose a novel method named Biomedical Confident Itemsets Explanation (BioCIE), aiming at post-hoc explanation of black-box machine learning models for biomedical text classification. Using sources of domain knowledge and a confident itemset mining method, BioCIE discretizes the decision space of a black-box into smaller subspaces and extracts semantic relationships between the input text and class labels in different subspaces. Confident itemsets discover how biomedical concepts are related to class labels in the black-box's decision space. BioCIE uses the itemsets to approximate the black-box's behavior for individual predictions. Optimizing fidelity, interpretability, and coverage measures, BioCIE produces class-wise explanations that represent decision boundaries of the black-box. Results of evaluations on various biomedical text classification tasks and black-box models demonstrated that BioCIE can outperform perturbation-based and decision set methods in terms of producing concise, accurate, and interpretable explanations. BioCIE improved the fidelity of instance-wise and class-wise explanations by 11.6% and 7.5%, respectively. It also improved the interpretability of explanations by 8%. BioCIE can be effectively used to explain how a black-box biomedical text classification model semantically relates input texts to class labels. The source code and supplementary material are available at https://github.com/mmoradi-iut/BioCIE.

📄 PDF Abstract BibTeX arXiv:2012.10928

Code (1)

mmoradi-iut/BioCIE 공식 구현 tf

Tasks

ClassificationGeneral Classificationtext-classificationText Classification

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

XOmiVAE: an interpretable deep learning model for cancer classification using high-dimensional omics data

2021-05-26 · Eloise Withnell, XiaoYu Zhang, Kai Sun, Yike Guo

The lack of explainability is one of the most prominent disadvantages of deep learning applications in omics. This "black box" problem can undermine the credibility and limit the practical implementation of biomedical de…

Cancer ClassificationClassificationClusteringDeep Learning+1

Explaining black-box text classifiers for disease-treatment information extraction

2020-10-21 · Milad Moradi, Matthias Samwald

Deep neural networks and other intricate Artificial Intelligence (AI) models have reached high levels of accuracy on many biomedical natural language processing tasks. However, their applicability in real-world use cases…

BBAEG: Towards BERT-based Biomedical Adversarial Example Generation for Text Classification

2021-04-05 · NAACL 2021 4 · Ishani Mondal

Healthcare predictive analytics aids medical decision-making, diagnosis prediction and drug review analysis. Therefore, prediction accuracy is an important criteria which also necessitates robust predictive language mode…

Decision MakingGeneral Classificationtext-classificationText Classification

Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead

2018-11-26 · Cynthia Rudin

Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creati…

BIG-bench Machine LearningDecision MakingInterpretable Machine Learning

Word-Level Uncertainty Estimation for Black-Box Text Classifiers using RNNs

2020-12-01 · COLING 2020 8 · Jakob Smedegaard Andersen, Tom Sch{\"o}ner, Walid Maalej

Estimating uncertainties of Neural Network predictions paves the way towards more reliable and trustful text classifications. However, common uncertainty estimation approaches remain as black-boxes without explaining whi…

Decision MakingSentiment Analysis