paper-with-me

Papers

Post Selection Inference with Incomplete Maximum Mean Discrepancy Estimator

2018-02-17 · ICLR 2019 5 · Makoto Yamada, Denny Wu, Yao-Hung Hubert Tsai, Ichiro Takeuchi, Ruslan Salakhutdinov, Kenji Fukumizu

Measuring divergence between two distributions is essential in machine learning and statistics and has various applications including binary classification, change point detection, and two-sample test. Furthermore, in the era of big data, designing divergence measure that is interpretable and can handle high-dimensional and complex data becomes extremely important. In the paper, we propose a post selection inference (PSI) framework for divergence measure, which can select a set of statistically significant features that discriminate two distributions. Specifically, we employ an additive variant of maximum mean discrepancy (MMD) for features and introduce a general hypothesis test for PSI. A novel MMD estimator using the incomplete U-statistics, which has an asymptotically Normal distribution (under mild assumptions) and gives high detection power in PSI, is also proposed and analyzed theoretically. Through synthetic and real-world feature selection experiments, we show that the proposed framework can successfully detect statistically significant features. Last, we propose a sample selection framework for analyzing different members in the Generative Adversarial Networks (GANs) family.

📄 PDF Abstract BibTeX arXiv:1802.06226

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationChange Point Detectionfeature selection

Similar Papers 제목 키워드 기반

Selecting the Best in GANs Family: a Post Selection Inference Framework

2018-02-15 · Yao-Hung Hubert Tsai, Makoto Yamada, Denny Wu, Ruslan Salakhutdinov 외

"Which Generative Adversarial Networks (GANs) generates the most plausible images?" has been a frequently asked question among researchers. To address this problem, we first propose an \emph{incomplete} U-statistics esti…

A Bayesian Tensor Factorization Model via Variational Inference for Link Prediction

2014-09-29 · Beyza Ermis, A. Taylan Cemgil

Probabilistic approaches for tensor factorization aim to extract meaningful structure from incomplete data by postulating low rank constraints. Recently, variational Bayesian (VB) inference techniques have successfully b…

Bayesian InferenceLink PredictionPredictionVariational Inference

Low-Complexity Methods for Estimation After Parameter Selection

2020-01-28

Statistical inference of multiple parameters often involves a preliminary parameter selection stage. The selection stage has an impact on subsequent estimation, for example by introducing a selection bias. The post-selec…

Selection bias

Laplace's Method Approximations for Probabilistic Inference in Belief Networks with Continuous Variables

2013-02-27 · Adriano Azevedo-Filho, Ross D. Shachter

Laplace's method, a family of asymptotic methods used to approximate integrals, is presented as a potential candidate for the tool box of techniques used for knowledge acquisition and probabilistic inference in belief ne…

Model Selection

Non-Bayesian Post-Model-Selection Estimation as Estimation Under Model Misspecification

2023-08-22 · Nadav Harel, Tirza Routtenberg

In many parameter estimation problems, the exact model is unknown and is assumed to belong to a set of candidate models. In such cases, a predetermined data-based selection rule selects a parametric model from a set of c…

channel selectionmodelModel Selectionparameter estimation