paper-with-me

홈 › Papers

Agnostic Estimation of Mean and Covariance

2016-04-24 · Kevin A. Lai, Anup B. Rao, Santosh Vempala

We consider the problem of estimating the mean and covariance of a distribution from iid samples in $\mathbb{R}^n$, in the presence of an $\eta$ fraction of malicious noise; this is in contrast to much recent work where the noise itself is assumed to be from a distribution of known type. The agnostic problem includes many interesting special cases, e.g., learning the parameters of a single Gaussian (or finding the best-fit Gaussian) when $\eta$ fraction of data is adversarially corrupted, agnostically learning a mixture of Gaussians, agnostic ICA, etc. We present polynomial-time algorithms to estimate the mean and covariance with error guarantees in terms of information-theoretic lower bounds. As a corollary, we also obtain an agnostic algorithm for Singular Value Decomposition.

📄 PDF Abstract BibTeX arXiv:1604.06968

Code (2)

kal2000/AgnosticMeanAndCovarianceCode 공식 구현
hoonose/robust-filter

Methods 이 논문이 사용한 방법론

ICA _Independent component analysis (ICA) is a statistical and computational technique for revealing hidden factors that underlie sets of random variables, measurements, or…

Similar Papers 제목 키워드 기반

TIC-TAC: A Framework for Improved Covariance Estimation in Deep Heteroscedastic Regression

2023-10-29 · Megh Shukla, Mathieu Salzmann, Alexandre Alahi

Deep heteroscedastic regression involves jointly optimizing the mean and covariance of the predicted distribution using the negative log-likelihood. However, recent works show that this may result in sub-optimal converge…

Pose Estimationregression

Non asymptotic estimation lower bounds for LTI state space models with Cramér-Rao and van Trees

2021-09-17 · Boualem Djehiche, Othmane Mazhar

We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean …

State Space Models

Fast, Sample-Efficient, Affine-Invariant Private Mean and Covariance Estimation for Subgaussian Distributions

2023-01-28 · Gavin Brown, Samuel B. Hopkins, Adam Smith

We present a fast, differentially private algorithm for high-dimensional covariance-aware mean estimation with nearly optimal sample complexity. Only exponential-time estimators were previously known to achieve this guar…

Open-Ended Question Answering

Sub-Gaussian estimators of the mean of a random matrix with heavy-tailed entries

2016-05-23 · Stanislav Minsker

Estimation of the covariance matrix has attracted a lot of attention of the statistical research community over the years, partially due to important applications such as Principal Component Analysis. However, frequently…

Matrix Completion

Joint mean and covariance estimation with unreplicated matrix-variate data

2016-11-13 · Michael Hornstein, Roger Fan, Kerby Shedden, Shuheng Zhou

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing…