paper-with-me

홈 › Papers

Position Paper: Integrating Explainability and Uncertainty Estimation in Medical AI

2025-09-14 · Xiuyi Fan arxiv

Uncertainty is a fundamental challenge in medical practice, but current medical AI systems fail to explicitly quantify or communicate uncertainty in a way that aligns with clinical reasoning. Existing XAI works focus on interpreting model predictions but do not capture the confidence or reliability of these predictions. Conversely, uncertainty estimation (UE) techniques provide confidence measures but lack intuitive explanations. The disconnect between these two areas limits AI adoption in medicine. To address this gap, we propose Explainable Uncertainty Estimation (XUE) that integrates explainability with uncertainty quantification to enhance trust and usability in medical AI. We systematically map medical uncertainty to AI uncertainty concepts and identify key challenges in implementing XUE. We outline technical directions for advancing XUE, including multimodal uncertainty quantification, model-agnostic visualization techniques, and uncertainty-aware decision support systems. Lastly, we propose guiding principles to ensure effective XUE realisation. Our analysis highlights the need for AI systems that not only generate reliable predictions but also articulate confidence levels in a clinically meaningful way. This work contributes to the development of trustworthy medical AI by bridging explainability and uncertainty, paving the way for AI systems that are aligned with real-world clinical complexities.

📄 PDF Abstract BibTeX arXiv:2509.18132

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

All You Need for Counterfactual Explainability Is Principled and Reliable Estimate of Aleatoric and Epistemic Uncertainty

2025-02-24 · Kacper Sokol, Eyke Hüllermeier

This position paper argues that, to its detriment, transparency research overlooks many foundational concepts of artificial intelligence. Here, we focus on uncertainty quantification -- in the context of ante-hoc interpr…

AllcounterfactualPositionUncertainty Quantification

Explainability through uncertainty: Trustworthy decision-making with neural networks

2024-03-15 · Arthur Thuy, Dries F. Benoit

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model perf…

Decision MakingExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)

Integrating Fuzzy Logic into Deep Symbolic Regression

2024-11-01 · Wout Gerdes, Erman Acar

Credit card fraud detection is a critical concern for financial institutions, intensified by the rise of contactless payment technologies. While deep learning models offer high accuracy, their lack of explainability pose…

Fraud DetectionregressionSymbolic Regression

Knowledge-Based Sequential Decision-Making Under Uncertainty

2019-05-16 · Daoming Lyu

Deep reinforcement learning (DRL) algorithms have achieved great success on sequential decision-making problems, yet is criticized for the lack of data-efficiency and explainability. Especially, explainability of subtask…

Decision MakingDecision Making Under UncertaintyDeep Reinforcement Learningreinforcement-learning+3

Variational Graph Convolutional Neural Networks

2025-07-02 · Illia Oleksiienko, Juho Kanniainen, Alexandros Iosifidis arxiv

Estimation of model uncertainty can help improve the explainability of Graph Convolutional Networks and the accuracy of the models at the same time. Uncertainty can also be used in critical applications to verify the res…

Action Recognition