paper-with-me

홈 › Papers

No Black Boxes: Interpretable and Interactable Predictive Healthcare with Knowledge-Enhanced Agentic Causal Discovery

2025-05-22 · Xiaoxue Han, Pengfei Hu, Jun-En Ding, Chang Lu, Feng Liu, Yue Ning

Deep learning models trained on extensive Electronic Health Records (EHR) data have achieved high accuracy in diagnosis prediction, offering the potential to assist clinicians in decision-making and treatment planning. However, these models lack two crucial features that clinicians highly value: interpretability and interactivity. The ``black-box'' nature of these models makes it difficult for clinicians to understand the reasoning behind predictions, limiting their ability to make informed decisions. Additionally, the absence of interactive mechanisms prevents clinicians from incorporating their own knowledge and experience into the decision-making process. To address these limitations, we propose II-KEA, a knowledge-enhanced agent-driven causal discovery framework that integrates personalized knowledge databases and agentic LLMs. II-KEA enhances interpretability through explicit reasoning and causal analysis, while also improving interactivity by allowing clinicians to inject their knowledge and experience through customized knowledge bases and prompts. II-KEA is evaluated on both MIMIC-III and MIMIC-IV, demonstrating superior performance along with enhanced interpretability and interactivity, as evidenced by its strong results from extensive case studies.

📄 PDF Abstract BibTeX arXiv:2505.16288

Code (0)

등록된 구현이 없습니다.

Tasks

Causal DiscoveryDecision Making

Similar Papers 제목 키워드 기반

Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead

2018-11-26 · Cynthia Rudin

Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creati…

BIG-bench Machine LearningDecision MakingInterpretable Machine Learning

Towards Interpretable Deep Neural Networks for Tabular Data

2025-09-10 · Khawla Elhadri, Jörg Schlötterer, Christin Seifert arxiv

Tabular data is the foundation of many applications in fields such as finance and healthcare. Although DNNs tailored for tabular data achieve competitive predictive performance, they are blackboxes with little interpreta…

FocusLearn: Fully-Interpretable, High-Performance Modular Neural Networks for Time Series

2023-11-28 · Qiqi Su, Christos Kloukinas, Artur d'Avila Garcez

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for b…

Additive modelsfeature selectionTime SeriesTime Series Forecasting+1

The future of human-centric eXplainable Artificial Intelligence (XAI) is not post-hoc explanations

2023-07-01 · Vinitra Swamy, Jibril Frej, Tanja Käser

Explainable Artificial Intelligence (XAI) plays a crucial role in enabling human understanding and trust in deep learning systems. As models get larger, more ubiquitous, and pervasive in aspects of daily life, explainabi…

Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)

"How do I fool you?": Manipulating User Trust via Misleading Black Box Explanations

2019-11-15 · Himabindu Lakkaraju, Osbert Bastani

As machine learning black boxes are increasingly being deployed in critical domains such as healthcare and criminal justice, there has been a growing emphasis on developing techniques for explaining these black boxes in …