paper-with-me

Papers

Sample based Explanations via Generalized Representers

2023-10-27 · NeurIPS 2023 11

We propose a general class of sample based explanations of machine learning models, which we term generalized representers. To measure the effect of a training sample on a model's test prediction, generalized representers use two components: a global sample importance that quantifies the importance of the training point to the model and is invariant to test samples, and a local sample importance that measures similarity between the training sample and the test point with a kernel. A key contribution of the paper is to show that generalized representers are the only class of sample based explanations satisfying a natural set of axiomatic properties. We discuss approaches to extract global importances given a kernel, and also natural choices of kernels given modern non-linear models. As we show, many popular existing sample based explanations could be cast as generalized representers with particular choices of kernels and approaches to extract global importances. Additionally, we conduct empirical comparisons of different generalized representers on two image and two text classification datasets.

📄 PDF Abstract BibTeX arXiv:2310.18526

Code (0)

등록된 구현이 없습니다.

Tasks

text-classificationText Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Representer Point Selection for Explaining Regularized High-dimensional Models

2023-05-31 · Che-Ping Tsai, Jiong Zhang, Eli Chien, Hsiang-Fu Yu 외

We introduce a novel class of sample-based explanations we term high-dimensional representers, that can be used to explain the predictions of a regularized high-dimensional model in terms of importance weights for each o…

Binary ClassificationCollaborative FilteringRecommendation Systems

Convex Representation Learning for Generalized Invariance in Semi-Inner-Product Space

2020-04-25 · ICML 2020 1 · Yingyi Ma, Vignesh Ganapathiraman, Yao-Liang Yu, Xinhua Zhang

Invariance (defined in a general sense) has been one of the most effective priors for representation learning. Direct factorization of parametric models is feasible only for a small range of invariances, while regulariza…

Representation Learning

Generalized SHAP: Generating multiple types of explanations in machine learning

2020-06-12 · Dillon Bowen, Lyle Ungar

Many important questions about a model cannot be answered just by explaining how much each feature contributes to its output. To answer a broader set of questions, we generalize a popular, mathematically well-grounded ex…

BIG-bench Machine LearningGeneral Classification

Two Approaches to Direct Estimation of Riesz Representers

2026-03-21 · David Bruns-Smith arxiv

The Riesz representer is a central object in semiparametric statistics and debiased/doubly-robust estimation. Two literatures in econometrics have highlighted the role for directly estimating Riesz representers: the auto…

Motivic clustering schemes for directed graphs

2020-01-01 · Facundo Mémoli, Guilherme Vituri F. Pinto

Motivated by the concept of network motifs we construct certain clustering methods (functors) which are parametrized by a given collection of motifs (or representers).

Clustering