paper-with-me

홈 › Papers

Challenging the Performance-Interpretability Trade-off: An Evaluation of Interpretable Machine Learning Models

2024-09-22 · Sven Kruschel, Nico Hambauer, Sven Weinzierl, Sandra Zilker, Mathias Kraus, Patrick Zschech

Machine learning is permeating every conceivable domain to promote data-driven decision support. The focus is often on advanced black-box models due to their assumed performance advantages, whereas interpretable models are often associated with inferior predictive qualities. More recently, however, a new generation of generalized additive models (GAMs) has been proposed that offer promising properties for capturing complex, non-linear patterns while remaining fully interpretable. To uncover the merits and limitations of these models, this study examines the predictive performance of seven different GAMs in comparison to seven commonly used machine learning models based on a collection of twenty tabular benchmark datasets. To ensure a fair and robust model comparison, an extensive hyperparameter search combined with cross-validation was performed, resulting in 68,500 model runs. In addition, this study qualitatively examines the visual output of the models to assess their level of interpretability. Based on these results, the paper dispels the misconception that only black-box models can achieve high accuracy by demonstrating that there is no strict trade-off between predictive performance and model interpretability for tabular data. Furthermore, the paper discusses the importance of GAMs as powerful interpretable models for the field of information systems and derives implications for future work from a socio-technical perspective.

📄 PDF Abstract BibTeX arXiv:2409.14429

Code (1)

NicoHambauer/Model-Performance-vs-Interpretability 공식 구현 pytorch

Tasks

Additive modelsInterpretable Machine Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Enforcing Interpretability and its Statistical Impacts: Trade-offs between Accuracy and Interpretability

2020-10-26 · Gintare Karolina Dziugaite, Shai Ben-David, Daniel M. Roy

To date, there has been no formal study of the statistical cost of interpretability in machine learning. As such, the discourse around potential trade-offs is often informal and misconceptions abound. In this work, we ai…

Binary ClassificationLearning TheoryMisconceptions

SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathology

2023-12-22 · CVPR 2024 1 · Saarthak Kapse, Pushpak Pati, Srijan Das, Jingwei Zhang 외

Introducing interpretability and reasoning into Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) analysis is challenging, given the complexity of gigapixel slides. Traditionally, MIL interpretability …

Multiple Instance Learning

Data Whitening Improves Sparse Autoencoder Learning

2025-11-17 · Ashwin Saraswatula, David Klindt arxiv

Sparse autoencoders (SAEs) have emerged as a promising approach for learning interpretable features from neural network activations. However, the optimization landscape for SAE training can be challenging due to correlat…

Learning Locally Interpretable Rule Ensemble

2023-06-20 · Kentaro Kanamori

This paper proposes a new framework for learning a rule ensemble model that is both accurate and interpretable. A rule ensemble is an interpretable model based on the linear combination of weighted rules. In practice, we…

The Promise and Peril of Human Evaluation for Model Interpretability

2017-11-20 · Bernease Herman

Transparency, user trust, and human comprehension are popular ethical motivations for interpretable machine learning. In support of these goals, researchers evaluate model explanation performance using humans and real wo…

DescriptiveInterpretable Machine LearningPosition