paper-with-me

홈 › Papers

Regional Tree Regularization for Interpretability in Black Box Models

2019-08-13 · Mike Wu, Sonali Parbhoo, Michael Hughes, Ryan Kindle, Leo Celi, Maurizio Zazzi, Volker Roth, Finale Doshi-Velez

The lack of interpretability remains a barrier to the adoption of deep neural networks. Recently, tree regularization has been proposed to encourage deep neural networks to resemble compact, axis-aligned decision trees without significant compromises in accuracy. However, it may be unreasonable to expect that a single tree can predict well across all possible inputs. In this work, we propose regional tree regularization, which encourages a deep model to be well-approximated by several separate decision trees specific to predefined regions of the input space. Practitioners can define regions based on domain knowledge of contexts where different decision-making logic is needed. Across many datasets, our approach delivers more accurate predictions than simply training separate decision trees for each region, while producing simpler explanations than other neural net regularization schemes without sacrificing predictive power. Two healthcare case studies in critical care and HIV demonstrate how experts can improve understanding of deep models via our approach.

📄 PDF Abstract BibTeX arXiv:1908.04494

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Making

Methods 이 논문이 사용한 방법론

Interpretability 설명 없음

Similar Papers 제목 키워드 기반

Optimizing for Interpretability in Deep Neural Networks with Tree Regularization

2019-08-14 · Mike Wu, Sonali Parbhoo, Michael C. Hughes, Volker Roth 외

Deep models have advanced prediction in many domains, but their lack of interpretability remains a key barrier to the adoption in many real world applications. There exists a large body of work aiming to help humans unde…

Local Interpretable Model Agnostic Shap Explanations for machine learning models

2022-10-10 · P. Sai Ram Aditya, Mayukha Pal

With the advancement of technology for artificial intelligence (AI) based solutions and analytics compute engines, machine learning (ML) models are getting more complex day by day. Most of these models are generally used…

Explainable Artificial Intelligence (XAI)

Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again

2026-06-30 · Zakk Heile, Hayden McTavish, Margo Seltzer, Cynthia Rudin arxiv

Recent work has shown that well-optimized individual decision trees can match complex black box models in some settings, primarily in noisy domains. For the remaining settings, however, complex ensembled compositions of …

Regularizing Black-box Models for Improved Interpretability (HILL 2019 Version)

2019-05-31 · Gregory Plumb, Maruan Al-Shedivat, Eric Xing, Ameet Talwalkar

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack gua…

BIG-bench Machine LearningInterpretable Machine Learning

Regionally Additive Models: Explainable-by-design models minimizing feature interactions

2023-09-21 · Vasilis Gkolemis, Anargiros Tzerefos, Theodore Dalamagas, Eirini Ntoutsi 외

Generalized Additive Models (GAMs) are widely used explainable-by-design models in various applications. GAMs assume that the output can be represented as a sum of univariate functions, referred to as components. However…

Additive models