paper-with-me

홈 › Papers

Spectral Regularized Kernel Two-Sample Tests

2022-12-19 · Omar Hagrass, Bharath K. Sriperumbudur, Bing Li

Over the last decade, an approach that has gained a lot of popularity to tackle nonparametric testing problems on general (i.e., non-Euclidean) domains is based on the notion of reproducing kernel Hilbert space (RKHS) embedding of probability distributions. The main goal of our work is to understand the optimality of two-sample tests constructed based on this approach. First, we show the popular MMD (maximum mean discrepancy) two-sample test to be not optimal in terms of the separation boundary measured in Hellinger distance. Second, we propose a modification to the MMD test based on spectral regularization by taking into account the covariance information (which is not captured by the MMD test) and prove the proposed test to be minimax optimal with a smaller separation boundary than that achieved by the MMD test. Third, we propose an adaptive version of the above test which involves a data-driven strategy to choose the regularization parameter and show the adaptive test to be almost minimax optimal up to a logarithmic factor. Moreover, our results hold for the permutation variant of the test where the test threshold is chosen elegantly through the permutation of the samples. Through numerical experiments on synthetic and real data, we demonstrate the superior performance of the proposed test in comparison to the MMD test and other popular tests in the literature.

📄 PDF Abstract BibTeX arXiv:2212.09201

Code (1)

OmarHagrass/Spectral-regularized-two-sample-test 공식 구현

Tasks

Vocal Bursts Valence Prediction

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Minimax Optimal Kernel Two-Sample Tests with Random Features

2025-02-28 · Soumya Mukherjee, Bharath K. Sriperumbudur

Reproducing Kernel Hilbert Space (RKHS) embedding of probability distributions has proved to be an effective approach, via MMD (maximum mean discrepancy) for nonparametric hypothesis testing problems involving distributi…

Computational Efficiency

Spectral Mixture Kernel Approximation Using Reparameterized Random Fourier Feature

2019-10-16 · pproximateinference AABI Symposium 2019 12 · Yohan Jung, Jinkyoo Park

We propose a method for Spectral Mixture kernel approximation using the Reparameterized Random Fourier Feature (R-RFF) in the sense of both general parameter and natural parameter view. Meanwhile, we provide the effectiv…

Spectral Regularized Kernel Goodness-of-Fit Tests

2023-08-08 · Omar Hagrass, Bharath K. Sriperumbudur, Bing Li

Maximum mean discrepancy (MMD) has enjoyed a lot of success in many machine learning and statistical applications, including non-parametric hypothesis testing, because of its ability to handle non-Euclidean data. Recentl…

Likelihood Ratio Tests by Kernel Gaussian Embedding

2025-08-11 · Leonardo V. Santoro, Victor M. Panaretos arxiv

We propose a novel kernel-based nonparametric two-sample test, employing the combined use of kernel mean and kernel covariance embedding. Our test builds on recent results showing how such combined embeddings map distinc…

Regularized $f$-Divergence Kernel Tests

2026-01-27 · Mónica Ribero, Antonin Schrab, Arthur Gretton arxiv

We propose a framework to construct practical kernel-based two-sample tests from the family of $f$-divergences. The test statistic is computed from the witness function of a regularized variational representation of the …

Two-sample testing