paper-with-me

홈 › Papers

Training Machine Learning Models by Regularizing their Explanations

2018-09-29 · Andrew Slavin Ross

Neural networks are among the most accurate supervised learning methods in use today. However, their opacity makes them difficult to trust in critical applications, especially when conditions in training may differ from those in practice. Recent efforts to develop explanations for neural networks and machine learning models more generally have produced tools to shed light on the implicit rules behind predictions. These tools can help us identify when models are right for the wrong reasons. However, they do not always scale to explaining predictions for entire datasets, are not always at the right level of abstraction, and most importantly cannot correct the problems they reveal. In this thesis, we explore the possibility of training machine learning models (with a particular focus on neural networks) using explanations themselves. We consider approaches where models are penalized not only for making incorrect predictions but also for providing explanations that are either inconsistent with domain knowledge or overly complex. These methods let us train models which can not only provide more interpretable rationales for their predictions but also generalize better when training data is confounded or meaningfully different from test data (even adversarially so).

📄 PDF Abstract BibTeX arXiv:1810.00869

Code (1)

dtak/rrr 공식 구현

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

Regularizing Black-box Models for Improved Interpretability

2019-02-18 · NeurIPS 2020 12 · Gregory Plumb, Maruan Al-Shedivat, Angel Alexander Cabrera, Adam Perer 외

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, whose explanat…

BIG-bench Machine LearningInterpretable Machine Learning

Show or Suppress? Managing Input Uncertainty in Machine Learning Model Explanations

2021-01-23 · Danding Wang, Wencan Zhang, Brian Y. Lim

Feature attribution is widely used in interpretable machine learning to explain how influential each measured input feature value is for an output inference. However, measurements can be uncertain, and it is unclear how …

BIG-bench Machine LearningInterpretable Machine Learning

Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations

2017-03-10 · Andrew Slavin Ross, Michael C. Hughes, Finale Doshi-Velez

Neural networks are among the most accurate supervised learning methods in use today, but their opacity makes them difficult to trust in critical applications, especially when conditions in training differ from those in …

Why do Random Forests Work? Understanding Tree Ensembles as Self-Regularizing Adaptive Smoothers

2024-02-02 · Alicia Curth, Alan Jeffares, Mihaela van der Schaar

Despite their remarkable effectiveness and broad application, the drivers of success underlying ensembles of trees are still not fully understood. In this paper, we highlight how interpreting tree ensembles as adaptive a…

XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models

2022-10-30 · Dong-Ho Lee, Akshen Kadakia, Brihi Joshi, Aaron Chan 외

NLP models are susceptible to learning spurious biases (i.e., bugs) that work on some datasets but do not properly reflect the underlying task. Explanation-based model debugging aims to resolve spurious biases by showing…

text-classificationText Classification