paper-with-me

홈 › Papers

Integrating Explainable AI in Medical Devices: Technical, Clinical and Regulatory Insights and Recommendations

2025-05-10 · Dima Alattal, Asal Khoshravan Azar, Puja Myles, Richard Branson, Hatim Abdulhussein, Allan Tucker

There is a growing demand for the use of Artificial Intelligence (AI) and Machine Learning (ML) in healthcare, particularly as clinical decision support systems to assist medical professionals. However, the complexity of many of these models, often referred to as black box models, raises concerns about their safe integration into clinical settings as it is difficult to understand how they arrived at their predictions. This paper discusses insights and recommendations derived from an expert working group convened by the UK Medicine and Healthcare products Regulatory Agency (MHRA). The group consisted of healthcare professionals, regulators, and data scientists, with a primary focus on evaluating the outputs from different AI algorithms in clinical decision-making contexts. Additionally, the group evaluated findings from a pilot study investigating clinicians' behaviour and interaction with AI methods during clinical diagnosis. Incorporating AI methods is crucial for ensuring the safety and trustworthiness of medical AI devices in clinical settings. Adequate training for stakeholders is essential to address potential issues, and further insights and recommendations for safely adopting AI systems in healthcare settings are provided.

📄 PDF Abstract BibTeX arXiv:2505.06620

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Persona-Based Requirements Engineering for Explainable Multi-Agent Educational Systems: A Scenario Simulator for Clinical Reasoning Training

2026-04-19 · Weibing Zheng, Laurah Turner, Jess Kropczynski, Matthew Kelleher 외 arxiv

As Artificial Intelligence (AI) and Agentic AI become increasingly integrated across sectors such as education and healthcare, it is critical to ensure that Multi-Agent Education System (MAES) is explainable from the ear…

Position Paper: Integrating Explainability and Uncertainty Estimation in Medical AI

2025-09-14 · Xiuyi Fan arxiv

Uncertainty is a fundamental challenge in medical practice, but current medical AI systems fail to explicitly quantify or communicate uncertainty in a way that aligns with clinical reasoning. Existing XAI works focus on …

Guidelines and Evaluation of Clinical Explainable AI in Medical Image Analysis

2022-02-16 · Weina Jin, Xiaoxiao Li, Mostafa Fatehi, Ghassan Hamarneh

Explainable artificial intelligence (XAI) is essential for enabling clinical users to get informed decision support from AI and comply with evidence-based medical practice. Applying XAI in clinical settings requires prop…

Computational EfficiencyExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)Medical Image Analysis

MedXplain-VQA: Multi-Component Explainable Medical Visual Question Answering

2025-10-26 · Hai-Dang Nguyen, Minh-Anh Dang, Minh-Tan Le, Minh-Tuan Le arxiv

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehens…

Visual Question Answering

Why we do need Explainable AI for Healthcare

2022-06-30 · Giovanni Cinà, Tabea Röber, Rob Goedhart, Ilker Birbil

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI and its promise to render AI de…

Specificityvalid