paper-with-me

Papers

A Spectral Algorithm for List-Decodable Covariance Estimation in Relative Frobenius Norm

2023-05-01 · NeurIPS 2023 11

We study the problem of list-decodable Gaussian covariance estimation. Given a multiset $T$ of $n$ points in $\mathbb R^d$ such that an unknown $\alpha<1/2$ fraction of points in $T$ are i.i.d. samples from an unknown Gaussian $\mathcal{N}(\mu, \Sigma)$, the goal is to output a list of $O(1/\alpha)$ hypotheses at least one of which is close to $\Sigma$ in relative Frobenius norm. Our main result is a $\mathrm{poly}(d,1/\alpha)$ sample and time algorithm for this task that guarantees relative Frobenius norm error of $\mathrm{poly}(1/\alpha)$. Importantly, our algorithm relies purely on spectral techniques. As a corollary, we obtain an efficient spectral algorithm for robust partial clustering of Gaussian mixture models (GMMs) -- a key ingredient in the recent work of [BDJ+22] on robustly learning arbitrary GMMs. Combined with the other components of [BDJ+22], our new method yields the first Sum-of-Squares-free algorithm for robustly learning GMMs. At the technical level, we develop a novel multi-filtering method for list-decodable covariance estimation that may be useful in other settings.

📄 PDF Abstract BibTeX arXiv:2305.00966

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

List-Decodable Covariance Estimation

2022-06-22 · Misha Ivkov, Pravesh K. Kothari

We give the first polynomial time algorithm for \emph{list-decodable covariance estimation}. For any $\alpha > 0$, our algorithm takes input a sample $Y \subseteq \mathbb{R}^d$ of size $n\geq d^{\mathsf{poly}(1/\alpha)}$…

regression

List-Decodable Mean Estimation via Iterative Multi-Filtering

2020-06-18 · NeurIPS 2020 12 · Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard

We study the problem of {\em list-decodable mean estimation} for bounded covariance distributions. Specifically, we are given a set $T$ of points in $\mathbb{R}^d$ with the promise that an unknown $\alpha$-fraction of po…

List-Decodable Mean Estimation in Nearly-PCA Time

2020-11-19 · NeurIPS 2021 12 · Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li 외

Traditionally, robust statistics has focused on designing estimators tolerant to a minority of contaminated data. Robust list-decodable learning focuses on the more challenging regime where only a minority $\frac 1 k$ fr…

Clustering

High-Accuracy List-Decodable Mean Estimation

2025-11-21 · Ziyun Chen, Spencer Compton, Daniel Kane, Jerry Li arxiv

In list-decodable learning, we are given a set of data points such that an $α$-fraction of these points come from a nice distribution $D$, for some small $α\ll 1$, and the goal is to output a short list of candidate solu…

List-Decodable Robust Mean Estimation and Learning Mixtures of Spherical Gaussians

2017-11-20 · Ilias Diakonikolas, Daniel M. Kane, Alistair Stewart

We study the problem of list-decodable Gaussian mean estimation and the related problem of learning mixtures of separated spherical Gaussians. We develop a set of techniques that yield new efficient algorithms with signi…