paper-with-me

홈 › Papers

More Powerful Selective Kernel Tests for Feature Selection

2019-10-14 · Jen Ning Lim, Makoto Yamada, Wittawat Jitkrittum, Yoshikazu Terada, Shigeyuki Matsui, Hidetoshi Shimodaira

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning on the selection procedure to account for how we have used the data to generate our hypotheses, and prevent information to be used again after selection. Many selective inference (a.k.a. post-selection inference) algorithms typically take this approach but will "over-condition" for sake of tractability. While this practice yields well calibrated statistic tests with controlled false positive rates (FPR), it can incur a major loss in power. In our work, we extend two recent proposals for selecting features using the Maximum Mean Discrepancy and Hilbert Schmidt Independence Criterion to condition on the minimal conditioning event. We show how recent advances in multiscale bootstrap makes conditioning on the minimal selection event possible and demonstrate our proposal over a range of synthetic and real world experiments. Our results show that our proposed test is indeed more powerful in most scenarios.

📄 PDF Abstract BibTeX arXiv:1910.06134

Code (1)

jenninglim/multiscale-features 공식 구현

Tasks

feature selectionSelection bias

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Learning Kernel Tests Without Data Splitting

2020-06-03 · NeurIPS 2020 12 · Jonas M. Kübler, Wittawat Jitkrittum, Bernhard Schölkopf, Krikamol Muandet

Modern large-scale kernel-based tests such as maximum mean discrepancy (MMD) and kernelized Stein discrepancy (KSD) optimize kernel hyperparameters on a held-out sample via data splitting to obtain the most powerful test…

B-tests: Low Variance Kernel Two-Sample Tests

2013-07-08 · Wojciech Zaremba, Arthur Gretton, Matthew Blaschko

A family of maximum mean discrepancy (MMD) kernel two-sample tests is introduced. Members of the test family are called Block-tests or B-tests, since the test statistic is an average over MMDs computed on subsets of the …

Two-sample testingVocal Bursts Valence Prediction

Meta Two-Sample Testing: Learning Kernels for Testing with Limited Data

2021-06-14 · NeurIPS 2021 12 · Feng Liu, Wenkai Xu, Jie Lu, Danica J. Sutherland

Modern kernel-based two-sample tests have shown great success in distinguishing complex, high-dimensional distributions with appropriate learned kernels. Previous work has demonstrated that this kernel learning procedure…

Two-sample testingVocal Bursts Valence Prediction

On RKHS Choices for Assessing Graph Generators via Kernel Stein Statistics

2022-10-11 · Moritz Weckbecker, Wenkai Xu, Gesine Reinert

Score-based kernelised Stein discrepancy (KSD) tests have emerged as a powerful tool for the goodness of fit tests, especially in high dimensions; however, the test performance may depend on the choice of kernels in an u…

A Kernel Test for Three-Variable Interactions

2013-06-10 · NeurIPS 2013 12 · Dino Sejdinovic, Arthur Gretton, Wicher Bergsma

We introduce kernel nonparametric tests for Lancaster three-variable interaction and for total independence, using embeddings of signed measures into a reproducing kernel Hilbert space. The resulting test statistics are …