paper-with-me

Papers

A Block-Coordinate Descent Approach for Large-scale Sparse Inverse Covariance Estimation

2014-12-01 · NeurIPS 2014 12 · Eran Treister, Javier S. Turek

The sparse inverse covariance estimation problem arises in many statistical applications in machine learning and signal processing. In this problem, the inverse of a covariance matrix of a multivariate normal distribution is estimated, assuming that it is sparse. An $\ell_1$ regularized log-determinant optimization problem is typically solved to approximate such matrices. Because of memory limitations, most existing algorithms are unable to handle large scale instances of this problem. In this paper we present a new block-coordinate descent approach for solving the problem for large-scale data sets. Our method treats the sought matrix block-by-block using quadratic approximations, and we show that this approach has advantages over existing methods in several aspects. Numerical experiments on both synthetic and real gene expression data demonstrate that our approach outperforms the existing state of the art methods, especially for large-scale problems.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A block-coordinate descent framework for non-convex composite optimization. Application to sparse precision matrix estimation

2026-01-29 · Guillaume Lauga arxiv

Block-coordinate descent (BCD) is the method of choice to solve numerous large scale optimization problems, however their theoretical study for non-convex optimization, has received less attention. In this paper, we pres…

Fast Sparse Group Lasso

2019-12-01 · NeurIPS 2019 12 · Yasutoshi Ida, Yasuhiro Fujiwara, Hisashi Kashima

Sparse Group Lasso is a method of linear regression analysis that finds sparse parameters in terms of both feature groups and individual features. Block Coordinate Descent is a standard approach to obtain the parameters …

Learning the Sparse and Low Rank PARAFAC Decomposition via the Elastic Net

2017-05-29 · Songting Shi, Xiang Li, Arkadiusz Sitek, Quanzheng Li

In this article, we derive a Bayesian model to learning the sparse and low rank PARAFAC decomposition for the observed tensor with missing values via the elastic net, with property to find the true rank and sparse factor…

Missing Values

Alternating Randomized Block Coordinate Descent

2018-07-01 · ICML 2018 7 · Jelena Diakonikolas, Lorenzo Orecchia

Block-coordinate descent algorithms and alternating minimization methods are fundamental optimization algorithms and an important primitive in large-scale optimization and machine learning. While various block-coord…

A Block-Coordinate Descent EMO Algorithm: Theoretical and Empirical Analysis

2024-04-04 · Benjamin Doerr, Joshua Knowles, Aneta Neumann, Frank Neumann

We consider whether conditions exist under which block-coordinate descent is asymptotically efficient in evolutionary multi-objective optimization, addressing an open problem. Block-coordinate descent, where an optimizat…

Scheduling