paper-with-me

Papers

Deep interpretable ensembles

2022-05-25 · Lucas Kook, Andrea Götschi, Philipp FM Baumann, Torsten Hothorn, Beate Sick

Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially interpretable semi-structured deep transformation models. However, interpretability of the ensemble members is generally lost upon aggregation. This is a crucial drawback of deep ensembles in high-stake decision fields, in which interpretable models are desired. We propose a novel transformation ensemble which aggregates probabilistic predictions with the guarantee to preserve interpretability and yield uniformly better predictions than the ensemble members on average. Transformation ensembles are tailored towards interpretable deep transformation models but are applicable to a wider range of probabilistic neural networks. In experiments on several publicly available data sets, we demonstrate that transformation ensembles perform on par with classical deep ensembles in terms of prediction performance, discrimination, and calibration. In addition, we demonstrate how transformation ensembles quantify both aleatoric and epistemic uncertainty, and produce minimax optimal predictions under certain conditions.

📄 PDF Abstract BibTeX arXiv:2205.12729

Code (0)

등록된 구현이 없습니다.

Tasks

Uncertainty Quantification

Methods 이 논문이 사용한 방법론

Deep Ensembles 설명 없음

Similar Papers 제목 키워드 기반

Making Tree Ensembles Interpretable

2016-06-17 · Satoshi Hara, Kohei Hayashi

Tree ensembles, such as random forest and boosted trees, are renowned for their high prediction performance, whereas their interpretability is critically limited. In this paper, we propose a post processing method that i…

Making Tree Ensembles Interpretable: A Bayesian Model Selection Approach

2016-06-29 · Satoshi Hara, Kohei Hayashi

Tree ensembles, such as random forests and boosted trees, are renowned for their high prediction performance. However, their interpretability is critically limited due to the enormous complexity. In this study, we presen…

Model Selection

What makes an Ensemble (Un) Interpretable?

2025-06-09 · Shahaf Bassan, Guy Amir, Meirav Zehavi, Guy Katz

Ensemble models are widely recognized in the ML community for their limited interpretability. For instance, while a single decision tree is considered interpretable, ensembles of trees (e.g., boosted trees) are often tre…

Generating Compact Tree Ensembles via Annealing

2017-09-16 · Gitesh Dawer, Yangzi Guo, Adrian Barbu

Tree ensembles are flexible predictive models that can capture relevant variables and to some extent their interactions in a compact and interpretable manner. Most algorithms for obtaining tree ensembles are based on ver…

Born-Again Tree Ensembles

2020-03-24 · ICML 2020 1 · Thibaut Vidal, Toni Pacheco, Maximilian Schiffer

The use of machine learning algorithms in finance, medicine, and criminal justice can deeply impact human lives. As a consequence, research into interpretable machine learning has rapidly grown in an attempt to better co…

BIG-bench Machine LearningInterpretable Machine Learning