paper-with-me

홈 › Papers

Data Science Principles for Interpretable and Explainable AI

2024-05-17 · Kris Sankaran

Society's capacity for algorithmic problem-solving has never been greater. Artificial Intelligence is now applied across more domains than ever, a consequence of powerful abstractions, abundant data, and accessible software. As capabilities have expanded, so have risks, with models often deployed without fully understanding their potential impacts. Interpretable and interactive machine learning aims to make complex models more transparent and controllable, enhancing user agency. This review synthesizes key principles from the growing literature in this field. We first introduce precise vocabulary for discussing interpretability, like the distinction between glass box and explainable models. We then explore connections to classical statistical and design principles, like parsimony and the gulfs of interaction. Basic explainability techniques -- including learned embeddings, integrated gradients, and concept bottlenecks -- are illustrated with a simple case study. We also review criteria for objectively evaluating interpretability approaches. Throughout, we underscore the importance of considering audience goals when designing interactive data-driven systems. Finally, we outline open challenges and discuss the potential role of data science in addressing them. Code to reproduce all examples can be found at https://go.wisc.edu/3k1ewe.

📄 PDF Abstract BibTeX arXiv:2405.10552

Code (1)

krisrs1128/interpretability_review 공식 구현 pytorch

Tasks

Explainable Models

Similar Papers 제목 키워드 기반

Signals, Concepts, and Laws: Toward Universal, Explainable Time-Series Forecasting

2025-08-02 · Hongwei Ma, Junbin Gao, Minh-Ngoc Tran arxiv

Accurate, explainable and physically credible forecasting remains a persistent challenge for multivariate time-series whose statistical properties vary across domains. We propose DORIC, a Domain-Universal, ODE-Regularize…

Explain the Black Box for the Sake of Science: the Scientific Method in the Era of Generative Artificial Intelligence

2024-06-15 · Gianmarco Mengaldo

The scientific method is the cornerstone of human progress across all branches of the natural and applied sciences, from understanding the human body to explaining how the universe works. The scientific method is based o…

scientific discovery

Extending Explainable Boosting Machines to Scientific Image Data

2023-05-25 · Daniel Schug, Sai Yerramreddy, Rich Caruana, Craig Greenberg 외

As the deployment of computer vision technology becomes increasingly common in science, the need for explanations of the system and its output has become a focus of great concern. Driven by the pressing need for interpre…

Who is this Explanation for? Human Intelligence and Knowledge Graphs for eXplainable AI

2020-05-27 · Irene Celino

eXplainable AI focuses on generating explanations for the output of an AI algorithm to a user, usually a decision-maker. Such user needs to interpret the AI system in order to decide whether to trust the machine outcome.…

Knowledge Graphs

Is Grad-CAM Explainable in Medical Images?

2023-07-20 · Subhashis Suara, Aayush Jha, Pratik Sinha, Arif Ahmed Sekh

Explainable Deep Learning has gained significant attention in the field of artificial intelligence (AI), particularly in domains such as medical imaging, where accurate and interpretable machine learning models are cruci…

Decision MakingDeep LearningInterpretable Machine Learning