paper-with-me

Papers

Large-Scale Optimization Algorithms for Sparse Conditional Gaussian Graphical Models

2015-09-15 · Calvin Mccarter, Seyoung Kim

This paper addresses the problem of scalable optimization for L1-regularized conditional Gaussian graphical models. Conditional Gaussian graphical models generalize the well-known Gaussian graphical models to conditional distributions to model the output network influenced by conditioning input variables. While highly scalable optimization methods exist for sparse Gaussian graphical model estimation, state-of-the-art methods for conditional Gaussian graphical models are not efficient enough and more importantly, fail due to memory constraints for very large problems. In this paper, we propose a new optimization procedure based on a Newton method that efficiently iterates over two sub-problems, leading to drastic improvement in computation time compared to the previous methods. We then extend our method to scale to large problems under memory constraints, using block coordinate descent to limit memory usage while achieving fast convergence. Using synthetic and genomic data, we show that our methods can solve one million dimensional problems to high accuracy in a little over a day on a single machine.

📄 PDF Abstract BibTeX arXiv:1509.04681

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hybrid Conditional Gradient - Smoothing Algorithms with Applications to Sparse and Low Rank Regularization

2014-04-14 · Andreas Argyriou, Marco Signoretto, Johan Suykens

We study a hybrid conditional gradient - smoothing algorithm (HCGS) for solving composite convex optimization problems which contain several terms over a bounded set. Examples of these include regularization problems wit…

Federated Conditional Stochastic Optimization

2023-10-04 · NeurIPS 2023 11

Conditional stochastic optimization has found applications in a wide range of machine learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the demand for training models with large-scale …

Distributed OptimizationFederated LearningMeta-LearningStochastic Optimization

Estimation, Optimization, and Parallelism when Data is Sparse

2013-12-01 · NeurIPS 2013 12 · John Duchi, Michael. I. Jordan, Brendan Mcmahan

We study stochastic optimization problems when the \emph{data} is sparse, which is in a sense dual to the current understanding of high-dimensional statistical learning and optimization. We highlight both the difficulti…

Stochastic Optimization

Fast Stochastic Algorithms for Low-rank and Nonsmooth Matrix Problems

2018-09-27 · Dan Garber, Atara Kaplan

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknow…

Stochastic Optimization

Fast Optimization of Weighted Sparse Decision Trees for use in Optimal Treatment Regimes and Optimal Policy Design

2022-10-13 · Ali Behrouz, Mathias Lecuyer, Cynthia Rudin, Margo Seltzer

Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy d…