paper-with-me

홈 › Papers

Connecting Interpretability and Robustness in Decision Trees through Separation

2021-02-14 · Michal Moshkovitz, Yao-Yuan Yang, Kamalika Chaudhuri

Recent research has recognized interpretability and robustness as essential properties of trustworthy classification. Curiously, a connection between robustness and interpretability was empirically observed, but the theoretical reasoning behind it remained elusive. In this paper, we rigorously investigate this connection. Specifically, we focus on interpretation using decision trees and robustness to $l_{\infty}$-perturbation. Previous works defined the notion of $r$-separation as a sufficient condition for robustness. We prove upper and lower bounds on the tree size in case the data is $r$-separated. We then show that a tighter bound on the size is possible when the data is linearly separated. We provide the first algorithm with provable guarantees both on robustness, interpretability, and accuracy in the context of decision trees. Experiments confirm that our algorithm yields classifiers that are both interpretable and robust and have high accuracy. The code for the experiments is available at https://github.com/yangarbiter/interpretable-robust-trees .

📄 PDF Abstract BibTeX arXiv:2102.07048

Code (1)

yangarbiter/interpretable-robust-trees 공식 구현

Similar Papers 제목 키워드 기반

Improving Stability in Decision Tree Models

2023-05-26 · Dimitris Bertsimas, Vassilis Digalakis Jr

Owing to their inherently interpretable structure, decision trees are commonly used in applications where interpretability is essential. Recent work has focused on improving various aspects of decision trees, including t…

Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again

2026-06-30 · Zakk Heile, Hayden McTavish, Margo Seltzer, Cynthia Rudin arxiv

Recent work has shown that well-optimized individual decision trees can match complex black box models in some settings, primarily in noisy domains. For the remaining settings, however, complex ensembled compositions of …

Cultivating Archipelago of Forests: Evolving Robust Decision Trees through Island Coevolution

2024-12-18 · Adam Żychowski, Andrew Perrault, Jacek Mańdziuk

Decision trees are widely used in machine learning due to their simplicity and interpretability, but they often lack robustness to adversarial attacks and data perturbations. The paper proposes a novel island-based coevo…

DiversityInterpretable Machine Learning

An Interpretable Client Decision Tree Aggregation process for Federated Learning

2024-04-03 · Alberto Argente-Garrido, Cristina Zuheros, M. Victoria Luzón, Francisco Herrera

Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to…

Federated Learning

Decision Machines: Congruent Decision Trees

2021-01-27 · Jinxiong Zhang

The decision tree recursively partitions the input space into regions and derives axis-aligned decision boundaries from data. Despite its simplicity and interpretability, decision trees lack parameterized representation,…

Computational Efficiency