paper-with-me

Papers

Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead

2018-11-26 · Cynthia Rudin

Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to \textit{explain} black box models, rather than creating models that are \textit{interpretable} in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward -- it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.

📄 PDF Abstract BibTeX arXiv:1811.10154

Code (3)

csinva/imodels
mini-pw/2020L-WarsztatyBadawcze-InzynieriaCech
roccojhu/neural_regression_discontinuity

Tasks

BIG-bench Machine LearningDecision MakingInterpretable Machine Learning

Similar Papers 제목 키워드 기반

Investigating the Duality of Interpretability and Explainability in Machine Learning

2025-03-27 · Moncef Garouani, Josiane Mothe, Ayah Barhrhouj, Julien Aligon

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, m…

Explaining the Mistakes of Neural Networks with Latent Sympathetic Examples

2018-01-01 · ICLR 2018 1 · Riaan Zoetmulder, Efstratios Gavves, Peter O'Connor

Neural networks make mistakes. The reason why a mistake is made often remains a mystery. As such neural networks often are considered a black box. It would be useful to have a method that can give an explanation that is …

Explaining Explaining

2024-09-26 · Sergei Nirenburg, Marjorie McShane, Kenneth W. Goodman, Sanjay Oruganti

Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The expl…

Toward Machine-Guided, Human-Initiated Explanatory Interactive Learning

2020-07-20 · Teodora Popordanoska, Mohit Kumar, Stefano Teso

Recent work has demonstrated the promise of combining local explanations with active learning for understanding and supervising black-box models. Here we show that, under specific conditions, these algorithms may misrepr…

Active LearningClustering

ICX360: In-Context eXplainability 360 Toolkit

2025-11-14 · Dennis Wei, Ronny Luss, Xiaomeng Hu, Lucas Monteiro Paes 외 arxiv

Large Language Models (LLMs) have become ubiquitous in everyday life and are entering higher-stakes applications ranging from summarizing meeting transcripts to answering doctors' questions. As was the case with earlier …