paper-with-me

홈 › Papers

Provably efficient, succinct, and precise explanations

2021-11-01 · NeurIPS 2021 12 · Guy Blanc, Jane Lange, Li-Yang Tan

We consider the problem of explaining the predictions of an arbitrary blackbox model $f$: given query access to $f$ and an instance $x$, output a small set of $x$'s features that in conjunction essentially determines $f(x)$. We design an efficient algorithm with provable guarantees on the succinctness and precision of the explanations that it returns. Prior algorithms were either efficient but lacked such guarantees, or achieved such guarantees but were inefficient. We obtain our algorithm via a connection to the problem of {\sl implicitly} learning decision trees. The implicit nature of this learning task allows for efficient algorithms even when the complexity of $f$ necessitates an intractably large surrogate decision tree. We solve the implicit learning problem by bringing together techniques from learning theory, local computation algorithms, and complexity theory. Our approach of "explaining by implicit learning" shares elements of two previously disparate methods for post-hoc explanations, global and local explanations, and we make the case that it enjoys advantages of both.

📄 PDF Abstract BibTeX arXiv:2111.01576

Code (0)

등록된 구현이 없습니다.

Tasks

Learning Theory

Similar Papers 제목 키워드 기반

Provably Precise, Succinct and Efficient Explanations for Decision Trees

2022-05-19 · Yacine Izza, Alexey Ignatiev, Nina Narodytska, Martin C. Cooper 외

Decision trees (DTs) embody interpretable classifiers. DTs have been advocated for deployment in high-risk applications, but also for explaining other complex classifiers. Nevertheless, recent work has demonstrated that …

Succinct Representations for Concepts

2023-03-01 · Yang Yuan

Foundation models like chatGPT have demonstrated remarkable performance on various tasks. However, for many questions, they may produce false answers that look accurate. How do we train the model to precisely understand …

Misconceptions

On Tackling Explanation Redundancy in Decision Trees

2022-05-20 · Yacine Izza, Alexey Ignatiev, Joao Marques-Silva

Decision trees (DTs) epitomize the ideal of interpretability of machine learning (ML) models. The interpretability of decision trees motivates explainability approaches by so-called intrinsic interpretability, and it is …

Transformers are Inherently Succinct

2025-10-22 · Pascal Bergsträßer, Ryan Cotterell, Anthony W. Lin arxiv

We study succinctness as a measure of the expressive power of transformers. Succinctness -- how compactly a formalism can describe a language relative to other formalisms -- is a classical notion in logic and automata th…

Efficient Explanations for Knowledge Compilation Languages

2021-07-04 · Xuanxiang Huang, Yacine Izza, Alexey Ignatiev, Martin C. Cooper 외

Knowledge compilation (KC) languages find a growing number of practical uses, including in Constraint Programming (CP) and in Machine Learning (ML). In most applications, one natural question is how to explain the decisi…

Negation