paper-with-me

홈 › Papers

SQ Lower Bounds for Non-Gaussian Component Analysis with Weaker Assumptions

2024-03-07 · NeurIPS 2023 11 · Ilias Diakonikolas, Daniel Kane, Lisheng Ren, Yuxin Sun

We study the complexity of Non-Gaussian Component Analysis (NGCA) in the Statistical Query (SQ) model. Prior work developed a general methodology to prove SQ lower bounds for this task that have been applicable to a wide range of contexts. In particular, it was known that for any univariate distribution $A$ satisfying certain conditions, distinguishing between a standard multivariate Gaussian and a distribution that behaves like $A$ in a random hidden direction and like a standard Gaussian in the orthogonal complement, is SQ-hard. The required conditions were that (1) $A$ matches many low-order moments with the standard univariate Gaussian, and (2) the chi-squared norm of $A$ with respect to the standard Gaussian is finite. While the moment-matching condition is necessary for hardness, the chi-squared condition was only required for technical reasons. In this work, we establish that the latter condition is indeed not necessary. In particular, we prove near-optimal SQ lower bounds for NGCA under the moment-matching condition only. Our result naturally generalizes to the setting of a hidden subspace. Leveraging our general SQ lower bound, we obtain near-optimal SQ lower bounds for a range of concrete estimation tasks where existing techniques provide sub-optimal or even vacuous guarantees.

📄 PDF Abstract BibTeX arXiv:2403.04744

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

New Lower Bounds for Private Estimation and a Generalized Fingerprinting Lemma

2022-05-17 · Gautam Kamath, Argyris Mouzakis, Vikrant Singhal

We prove new lower bounds for statistical estimation tasks under the constraint of $(\varepsilon, \delta)$-differential privacy. First, we provide tight lower bounds for private covariance estimation of Gaussian distribu…

LEMMA

PTF Testing Lower Bounds for Non-Gaussian Component Analysis

2025-11-24 · Ilias Diakonikolas, Daniel M. Kane, Sihan Liu, Thanasis Pittas arxiv

This work studies information-computation gaps for statistical problems. A common approach for providing evidence of such gaps is to show sample complexity lower bounds (that are stronger than the information-theoretic o…

Sum-of-squares lower bounds for Non-Gaussian Component Analysis

2024-10-28 · Ilias Diakonikolas, Sushrut Karmalkar, Shuo Pang, Aaron Potechin

Non-Gaussian Component Analysis (NGCA) is the statistical task of finding a non-Gaussian direction in a high-dimensional dataset. Specifically, given i.i.d.\ samples from a distribution $P^A_{v}$ on $\mathbb{R}^n$ that b…

Lower Bounds on the Total Variation Distance Between Mixtures of Two Gaussians

2021-09-02 · Sami Davies, Arya Mazumdar, Soumyabrata Pal, Cyrus Rashtchian

Mixtures of high dimensional Gaussian distributions have been studied extensively in statistics and learning theory. While the total variation distance appears naturally in the sample complexity of distribution learning,…

Learning Theory

An Optimized Franz-Parisi Criterion and its Equivalence with SQ Lower Bounds

2025-06-06 · Siyu Chen, Theodor Misiakiewicz, Ilias Zadik, Peiyuan Zhang

Bandeira et al. (2022) introduced the Franz-Parisi (FP) criterion for characterizing the computational hard phases in statistical detection problems. The FP criterion, based on an annealed version of the celebrated Franz…

Additive models