paper-with-me

Papers

The Regularization Parameter: Sparse Precision Matrix Estimation

2026-07-07 · Aryan Eftekhari, Daniel Sergio Vega, Ernst-Jan Camiel Wit, Olaf Schenk arxiv

Sparse precision matrix estimation provides an interpretable and computationally efficient framework for modeling conditional dependencies in high-dimensional, low-sample-size data. A recurring challenge is appropriately selecting the regularization parameter that controls estimator sparsity and strikes a balance between underfitting and overfitting. We propose a closed-form, matrix-valued regularization parameter derived from the sampling distribution of the first-order optimality conditions of the $\ell_1$-regularized Gaussian maximum-likelihood estimator. By prescribing the probability that each nonzero entry of the estimator satisfies its optimality condition under resampling, we eliminate the need for cross-validation. The resulting regularization parameter is shown to attain asymptotic scaling properties that, under standard conditions, provide consistency and sparsistency of the estimator. On synthetic Gaussian and non-Gaussian datasets, as well as real-world gene microarray and neuroimaging applications, the proposed approach achieves estimation accuracy comparable to cross-validation, delivers superior support recovery, and reduces runtime by several orders of magnitude.

📄 PDF Abstract BibTeX arXiv:2607.07735

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Nonconvex Sparse Graph Learning under Laplacian Constrained Graphical Model

2020-12-01 · NeurIPS 2020 12 · Jiaxi Ying, José Vinícius de Miranda Cardoso , Daniel Palomar

In this paper, we consider the problem of learning a sparse graph from the Laplacian constrained Gaussian graphical model. This problem can be formulated as a penalized maximum likelihood estimation of the precision matr…

Graph Learning

Homotopy Parametric Simplex Method for Sparse Learning

2017-04-04 · Haotian Pang, Robert Vanderbei, Han Liu, Tuo Zhao

High dimensional sparse learning has imposed a great computational challenge to large scale data analysis. In this paper, we are interested in a broad class of sparse learning approaches formulated as linear programs par…

regressionSparse Learning

Does the $\ell_1$-norm Learn a Sparse Graph under Laplacian Constrained Graphical Models?

2020-06-26 · Jiaxi Ying, José Vinícius de M. Cardoso, Daniel P. Palomar

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained preci…

Bayesian Regularization for Graphical Models with Unequal Shrinkage

2018-05-06 · Lingrui Gan, Naveen N. Narisetty, Feng Liang

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the…

Convex Parameter Estimation of Perturbed Multivariate Generalized Gaussian Distributions

2023-12-12 · Nora Ouzir, Frédéric Pascal, Jean-Christophe Pesquet

The multivariate generalized Gaussian distribution (MGGD), also known as the multivariate exponential power (MEP) distribution, is widely used in signal and image processing. However, estimating MGGD parameters, which is…

parameter estimation