Extracting Explanations, Justification, and Uncertainty from Black-Box Deep Neural Networks
Deep Neural Networks (DNNs) do not inherently compute or exhibit empirically-justified task confidence. In mission critical applications, it is important to both understand associated DNN reasoning and its supporting evidence. In this paper, we propose a novel Bayesian approach to extract explanations, justifications, and uncertainty estimates from DNNs. Our approach is efficient both in terms of memory and computation, and can be applied to any black box DNN without any retraining, including applications to anomaly detection and out-of-distribution detection tasks. We validate our approach on the CIFAR-10 dataset, and show that it can significantly improve the interpretability and reliability of DNNs.
Code (0)
등록된 구현이 없습니다.
Tasks
Anomaly DetectionOut-of-Distribution DetectionSimilar Papers 제목 키워드 기반
Explaining Explanations in Probabilistic Logic Programming
The emergence of tools based on artificial intelligence has also led to the need of producing explanations which are understandable by a human being. In most approaches, the system is considered a black box, making it di…
CONFEX: Uncertainty-Aware Counterfactual Explanations with Conformal Guarantees
Counterfactual explanations (CFXs) provide human-understandable justifications for model predictions, enabling actionable recourse and enhancing interpretability. To be reliable, CFXs must avoid regions of high predictiv…
Boundary-Aware Uncertainty for Feature Attribution Explainers
Post-hoc explanation methods have become a critical tool for understanding black-box classifiers in high-stakes applications. However, high-performing classifiers are often highly nonlinear and can exhibit complex behavi…
The Explanation Game: Explaining Machine Learning Models Using Shapley Values
A number of techniques have been proposed to explain a machine learning model's prediction by attributing it to the corresponding input features. Popular among these are techniques that apply the Shapley value method fro…
BIG-bench Machine LearningLEAFAGE: Example-based and Feature importance-based Explanationsfor Black-box ML models
As machine learning models become more accurate, they typically become more complex and uninterpretable by humans. The black-box character of these models holds back its acceptance in practice, especially in high-risk do…
Feature Importance