paper-with-me

홈 › Papers

A Geometric Unification of Distributionally Robust Covariance Estimators: Shrinking the Spectrum by Inflating the Ambiguity Set

2024-05-30 · Man-Chung Yue, Yves Rychener, Daniel Kuhn, Viet Anh Nguyen

The state-of-the-art methods for estimating high-dimensional covariance matrices all shrink the eigenvalues of the sample covariance matrix towards a data-insensitive shrinkage target. The underlying shrinkage transformation is either chosen heuristically - without compelling theoretical justification - or optimally in view of restrictive distributional assumptions. In this paper, we propose a principled approach to construct covariance estimators without imposing restrictive assumptions. That is, we study distributionally robust covariance estimation problems that minimize the worst-case Frobenius error with respect to all data distributions close to a nominal distribution, where the proximity of distributions is measured via a divergence on the space of covariance matrices. We identify mild conditions on this divergence under which the resulting minimizers represent shrinkage estimators. We show that the corresponding shrinkage transformations are intimately related to the geometrical properties of the underlying divergence. We also prove that our robust estimators are efficiently computable and asymptotically consistent and that they enjoy finite-sample performance guarantees. We exemplify our general methodology by synthesizing explicit estimators induced by the Kullback-Leibler, Fisher-Rao, and Wasserstein divergences. Numerical experiments based on synthetic and real data show that our robust estimators are competitive with state-of-the-art estimators.

📄 PDF Abstract BibTeX arXiv:2405.20124

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

SCOPE: Spectral Concentration by Distributionally Robust Joint Covariance-Precision Estimation

2025-11-18 · Renjie Chen, Viet Anh Nguyen, Huifu Xu arxiv

We propose a distributionally robust formulation for simultaneously estimating the covariance matrix and the precision matrix of a random vector.The proposed model minimizes the worst-case weighted sum of the Frobenius l…

Distributionally Robust Formulation and Model Selection for the Graphical Lasso

2019-05-22 · Pedro Cisneros-Velarde, Sang-Yun Oh, Alexander Petersen

Building on a recent framework for distributionally robust optimization, we consider estimation of the inverse covariance matrix for multivariate data. We provide a novel notion of a Wasserstein ambiguity set specificall…

Model Selection

Estimation of Large Financial Covariances: A Cross-Validation Approach

2020-12-10 · Vincent Tan, Stefan Zohren

We introduce a novel covariance estimator for portfolio selection that adapts to the non-stationary or persistent heteroskedastic environments of financial time series by employing exponentially weighted averages and non…

ManagementTime SeriesTime Series Analysis

Algorithme EM régularisé

2023-07-04 · Pierre Houdouin, Matthieu Jonkcheere, Frederic Pascal

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing maximum likelihood estimate when dealing with Gaussian Mixture Model (GMM). When the sample size is smaller than the data dimensi…

Clustering

Distributionally Robust Receive Combining

2024-01-22 · Shixiong Wang, Wei Dai, Geoffrey Ye Li

This article investigates signal estimation in wireless transmission (i.e., receive combining) from the perspective of statistical machine learning, where the transmit signals may be from an integrated sensing and commun…

Integrated sensing and communication