paper-with-me

Papers

Sparse Inverse Covariance Estimation for Chordal Structures

2017-11-24 · Salar Fattahi, Richard Y. Zhang, Somayeh Sojoudi

In this paper, we consider the Graphical Lasso (GL), a popular optimization problem for learning the sparse representations of high-dimensional datasets, which is well-known to be computationally expensive for large-scale problems. Recently, we have shown that the sparsity pattern of the optimal solution of GL is equivalent to the one obtained from simply thresholding the sample covariance matrix, for sparse graphs under different conditions. We have also derived a closed-form solution that is optimal when the thresholded sample covariance matrix has an acyclic structure. As a major generalization of the previous result, in this paper we derive a closed-form solution for the GL for graphs with chordal structures. We show that the GL and thresholding equivalence conditions can significantly be simplified and are expected to hold for high-dimensional problems if the thresholded sample covariance matrix has a chordal structure. We then show that the GL and thresholding equivalence is enough to reduce the GL to a maximum determinant matrix completion problem and drive a recursive closed-form solution for the GL when the thresholded sample covariance matrix has a chordal structure. For large-scale problems with up to 450 million variables, the proposed method can solve the GL problem in less than 2 minutes, while the state-of-the-art methods converge in more than 2 hours.

📄 PDF Abstract BibTeX arXiv:1711.09131

Code (0)

등록된 구현이 없습니다.

Tasks

FormMatrix Completion

Similar Papers 제목 키워드 기반

L0 Sparse Inverse Covariance Estimation

2014-08-05 · Goran Marjanovic, Alfred O. Hero III

Recently, there has been focus on penalized log-likelihood covariance estimation for sparse inverse covariance (precision) matrices. The penalty is responsible for inducing sparsity, and a very common choice is the conve…

EiGLasso for Scalable Sparse Kronecker-Sum Inverse Covariance Estimation

2021-05-20 · Jun Ho Yoon, Seyoung Kim

In many real-world problems, complex dependencies are present both among samples and among features. The Kronecker sum or the Cartesian product of two graphs, each modeling dependencies across features and across samples…

Inverse Covariance and Partial Correlation Matrix Estimation via Joint Partial Regression

2025-02-12 · Samuel Erickson, Tobias Rydén

We present a method for estimating sparse high-dimensional inverse covariance and partial correlation matrices, which exploits the connection between the inverse covariance matrix and linear regression. The method is a t…

A Novel Approach to Sparse Inverse Covariance Estimation Using Transform Domain Updates and Exponentially Adaptive Thresholding

2018-11-16 · Ashkan Esmaeili, Farokh Marvasti

Sparse Inverse Covariance Estimation (SICE) is useful in many practical data analyses. Recovering the connectivity, non-connectivity graph of covariates is classified amongst the most important data mining and learning p…

Certifiably Optimal Sparse Inverse Covariance Estimation

2019-06-25 · Dimitris Bertsimas, Jourdain Lamperski, Jean Pauphilet

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel appro…