paper-with-me

Papers

Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learning

2023-04-10 · CVPR 2023 1 · Hanjing Wang, Dhiraj Joshi, Shiqiang Wang, Qiang Ji

Predictions made by deep learning models are prone to data perturbations, adversarial attacks, and out-of-distribution inputs. To build a trusted AI system, it is therefore critical to accurately quantify the prediction uncertainties. While current efforts focus on improving uncertainty quantification accuracy and efficiency, there is a need to identify uncertainty sources and take actions to mitigate their effects on predictions. Therefore, we propose to develop explainable and actionable Bayesian deep learning methods to not only perform accurate uncertainty quantification but also explain the uncertainties, identify their sources, and propose strategies to mitigate the uncertainty impacts. Specifically, we introduce a gradient-based uncertainty attribution method to identify the most problematic regions of the input that contribute to the prediction uncertainty. Compared to existing methods, the proposed UA-Backprop has competitive accuracy, relaxed assumptions, and high efficiency. Moreover, we propose an uncertainty mitigation strategy that leverages the attribution results as attention to further improve the model performance. Both qualitative and quantitative evaluations are conducted to demonstrate the effectiveness of our proposed methods.

📄 PDF Abstract BibTeX arXiv:2304.04824

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningUncertainty Quantification

Similar Papers 제목 키워드 기반

Explainable Learning with Gaussian Processes

2024-03-11 · Kurt Butler, Guanchao Feng, Petar M. Djuric

The field of explainable artificial intelligence (XAI) attempts to develop methods that provide insight into how complicated machine learning methods make predictions. Many methods of explanation have focused on the conc…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Gaussian ProcessesGPR

No Single Metric Tells the Whole Story: A Multi-Dimensional Evaluation Framework for Uncertainty Attributions

2026-03-25 · Emily Schiller, Teodor Chiaburu, Marco Zullich, Luca Longo arxiv

Research on explainable AI (XAI) has frequently focused on explaining model predictions. More recently, methods have been proposed to explain prediction uncertainty by attributing it to input features (uncertainty attrib…

EvalAttAI: A Holistic Approach to Evaluating Attribution Maps in Robust and Non-Robust Models

2023-03-15 · Ian E. Nielsen, Ravi P. Ramachandran, Nidhal Bouaynaya, Hassan M. Fathallah-Shaykh 외

The expansion of explainable artificial intelligence as a field of research has generated numerous methods of visualizing and understanding the black box of a machine learning model. Attribution maps are generally used t…

Explainable artificial intelligence

A Unified Framework for Uncertainty-Aware Explainable Artificial Intelligence: A Case Study in Power Quality Disturbance Classification

2026-05-20 · Yinsong Chen, Samson S. Yu, Zhong Li, Chee Peng Lim arxiv

Post-hoc explainable AI (XAI) methods usually return one attribution map, even when the model represents uncertainty in its parameters. We define the \emph{explanation distribution} as the distribution of attribution map…

Riemannian Integrated Gradients: A Geometric View of Explainable AI

2025-03-02 · Federico Costanza, Lachlan Simpson

We introduce Riemannian Integrated Gradients (RIG); an extension of Integrated Gradients (IG) to Riemannian manifolds. We demonstrate that RIG restricts to IG when the Riemannian manifold is Euclidean space. We show that…