paper-with-me

Papers

Sparse Inverse Covariance Matrix Estimation Using Quadratic Approximation

2013-06-13 · NeurIPS 2011 12 · Cho-Jui Hsieh, Matyas A. Sustik, Inderjit S. Dhillon, Pradeep Ravikumar

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov Random Field, from very limited samples. We propose a novel algorithm for solving the resulting optimization problem which is a regularized log-determinant program. In contrast to recent state-of-the-art methods that largely use first order gradient information, our algorithm is based on Newton's method and employs a quadratic approximation, but with some modifications that leverage the structure of the sparse Gaussian MLE problem. We show that our method is superlinearly convergent, and present experimental results using synthetic and real-world application data that demonstrate the considerable improvements in performance of our method when compared to other state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:1306.3212

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

EiGLasso for Scalable Sparse Kronecker-Sum Inverse Covariance Estimation

2021-05-20 · Jun Ho Yoon, Seyoung Kim

In many real-world problems, complex dependencies are present both among samples and among features. The Kronecker sum or the Cartesian product of two graphs, each modeling dependencies across features and across samples…

A Block-Coordinate Descent Approach for Large-scale Sparse Inverse Covariance Estimation

2014-12-01 · NeurIPS 2014 12 · Eran Treister, Javier S. Turek

The sparse inverse covariance estimation problem arises in many statistical applications in machine learning and signal processing. In this problem, the inverse of a covariance matrix of a multivariate normal distributio…

Inverse Covariance and Partial Correlation Matrix Estimation via Joint Partial Regression

2025-02-12 · Samuel Erickson, Tobias Rydén

We present a method for estimating sparse high-dimensional inverse covariance and partial correlation matrices, which exploits the connection between the inverse covariance matrix and linear regression. The method is a t…

A multilevel framework for sparse optimization with application to inverse covariance estimation and logistic regression

2016-07-01 · Eran Treister, Javier S. Turek, Irad Yavneh

Solving l1 regularized optimization problems is common in the fields of computational biology, signal processing and machine learning. Such l1 regularization is utilized to find sparse minimizers of convex functions. A w…

regression

BIG & QUIC: Sparse Inverse Covariance Estimation for a Million Variables

2013-12-01 · NeurIPS 2013 12 · Cho-Jui Hsieh, Matyas A. Sustik, Inderjit S. Dhillon, Pradeep K. Ravikumar 외

The l1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix even under high-dimensional settings. However, it requi…

Clustering