paper-with-me

홈 › Papers

SCOPE: Spectral Concentration by Distributionally Robust Joint Covariance-Precision Estimation

2025-11-18 · Renjie Chen, Viet Anh Nguyen, Huifu Xu arxiv

We propose a distributionally robust formulation for simultaneously estimating the covariance matrix and the precision matrix of a random vector.The proposed model minimizes the worst-case weighted sum of the Frobenius loss of the covariance estimator and Stein's loss of the precision matrix estimator against all distributions from an ambiguity set centered at the nominal distribution. The radius of the ambiguity set is measured via convex spectral divergence. We demonstrate that the proposed distributionally robust estimation model can be reduced to a convex optimization problem, thereby yielding quasi-analytical estimators. The joint estimators are shown to be nonlinear shrinkage estimators. The eigenvalues of the estimators are shrunk nonlinearly towards a positive scalar, where the scalar is determined by the weight coefficient of the loss terms. By tuning the coefficient carefully, the shrinkage corrects the spectral bias of the empirical covariance/precision matrix estimator. By this property, we call the proposed joint estimator the Spectral concentrated COvariance and Precision matrix Estimator (SCOPE). We demonstrate that the shrinkage effect improves the condition number of the estimator. We provide a parameter-tuning scheme that adjusts the shrinkage target and intensity that is asymptotically optimal. Numerical experiments on synthetic and real data show that our shrinkage estimators perform competitively against state-of-the-art estimators in practical applications.

📄 PDF Abstract BibTeX arXiv:2511.14146

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Spectral Properties of Radial Kernels and Clustering in High Dimensions

2019-06-25 · David Cohen-Steiner, Alba Chiara de Vitis

In this paper, we study the spectrum and the eigenvectors of radial kernels for mixtures of distributions in $\mathbb{R}^n$. Our approach focuses on high dimensions and relies solely on the concentration properties of th…

ClusteringVocal Bursts Intensity Prediction

Spectral-transport stability and benign overfitting for minimum norm interpolation

2026-04-09 · Gustav Olaf Yunus Laitinen-Lundström Fredriksson-Imanov arxiv

Benign overfitting describes the ability of minimum norm interpolating estimators to generalize despite fitting noisy data exactly. Existing characterizations depend on delicate spectral functionals of the population cov…

Distributionally Robust Adaptive Beamforming

2024-11-10 · Shixiong Wang, Wei Dai, Geoffrey Ye Li

As a fundamental technique in array signal processing, beamforming plays a crucial role in amplifying signals of interest (SoI) while mitigating interference plus noise (IPN). When uncertainties exist in the signal model…

subspace methods

Spectral Entropy Collapse as a Phase Transition in Delayed Generalisation: An Interventional and Predictive Framework for Grokkin

2026-04-13 · Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung, Phan Thanh Duc arxiv

Grokking - the delayed transition from memorisation to generalisation in neural networks - remains poorly understood. We study this phenomenon through the geometry of learned representations and identify a consistent emp…

Provable Subspace Identification of Nonlinear Multi-view CCA

2026-02-27 · Zhiwei Han, Stefan Matthes, Hao Shen arxiv

We investigate the identifiability of nonlinear canonical correlation analysis (CCA) in a multi-view setup, in which each view is generated by applying an unknown nonlinear map to a linear mixture of shared latent variab…