paper-with-me

홈 › Papers

An unexpected unity among methods for interpreting model predictions

2016-11-22 · Scott Lundberg, Su-In Lee

Understanding why a model made a certain prediction is crucial in many data science fields. Interpretable predictions engender appropriate trust and provide insight into how the model may be improved. However, with large modern datasets the best accuracy is often achieved by complex models even experts struggle to interpret, which creates a tension between accuracy and interpretability. Recently, several methods have been proposed for interpreting predictions from complex models by estimating the importance of input features. Here, we present how a model-agnostic additive representation of the importance of input features unifies current methods. This representation is optimal, in the sense that it is the only set of additive values that satisfies important properties. We show how we can leverage these properties to create novel visual explanations of model predictions. The thread of unity that this representation weaves through the literature indicates that there are common principles to be learned about the interpretation of model predictions that apply in many scenarios.

📄 PDF Abstract BibTeX arXiv:1611.07478

Code (0)

등록된 구현이 없습니다.

Tasks

Unity

Similar Papers 제목 키워드 기반

GrammarSHAP: An Efficient Model-Agnostic and Structure-Aware NLP Explainer

2022-05-01 · LNLS (ACL) 2022 5 · Edoardo Mosca, Defne Demirtürk, Luca Mülln, Fabio Raffagnato 외

Interpreting NLP models is fundamental for their development as it can shed light on hidden properties and unexpected behaviors. However, while transformer architectures exploit contextual information to enhance their pr…

Constituency ParsingSentence

Shapley Flow: A Graph-based Approach to Interpreting Model Predictions

2020-10-27 · Jiaxuan Wang, Jenna Wiens, Scott Lundberg

Many existing approaches for estimating feature importance are problematic because they ignore or hide dependencies among features. A causal graph, which encodes the relationships among input variables, can aid in assign…

Feature Importance

Interpretable and Explainable Machine Learning for Materials Science and Chemistry

2021-11-01 · Felipe Oviedo, Juan Lavista Ferres, Tonio Buonassisi, Keith Butler

While the uptake of data-driven approaches for materials science and chemistry is at an exciting, early stage, to realise the true potential of machine learning models for successful scientific discovery, they must have …

BIG-bench Machine LearningInterpretable Machine Learningscientific discovery

Peeking inside the Black Box: Interpreting Deep Learning Models for Exoplanet Atmospheric Retrievals

2020-11-23 · Kai Hou Yip, Quentin Changeat, Nikolaos Nikolaou, Mario Morvan 외

Deep learning algorithms are growing in popularity in the field of exoplanetary science due to their ability to model highly non-linear relations and solve interesting problems in a data-driven manner. Several works have…

Retrieval

This Must Be the Place: Predicting Engagement of Online Communities in a Large-scale Distributed Campaign

2022-01-14 · Abraham Israeli, Alexander Kremiansky, Oren Tsur

Understanding collective decision making at a large-scale, and elucidating how community organization and community dynamics shape collective behavior are at the heart of social science research. In this work we study th…

Decision Making