paper-with-me

Papers

Convergence Rate Analysis of MAP Coordinate Minimization Algorithms

2012-12-01 · NeurIPS 2012 12 · Ofer Meshi, Amir Globerson, Tommi S. Jaakkola

Finding maximum aposteriori (MAP) assignments in graphical models is an important task in many applications. Since the problem is generally hard, linear programming (LP) relaxations are often used. Solving these relaxations efficiently is thus an important practical problem. In recent years, several authors have proposed message passing updates corresponding to coordinate descent in the dual LP. However,these are generally not guaranteed to converge to a global optimum. One approach to remedy this is to smooth the LP, and perform coordinate descent on the smoothed dual. However, little is known about the convergence rate of this procedure. Here we perform a thorough rate analysis of such schemes and derive primal and dual convergence rates. We also provide a simple dual to primal mapping that yields feasible primal solutions with a guaranteed rate of convergence. Empirical evaluation supports our theoretical claims and shows that the method is highly competitive with state of the art approaches that yield global optima.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Feature Clustering for Accelerating Parallel Coordinate Descent

2012-12-01 · NeurIPS 2012 12 · Chad Scherrer, Ambuj Tewari, Mahantesh Halappanavar, David Haglin

Large scale $\ell_1$-regularized loss minimization problems arise in numerous applications such as compressed sensing and high dimensional supervised learning, including classification and regression problems. High perf…

Clusteringcompressed sensing

Alternating Randomized Block Coordinate Descent

2018-07-01 · ICML 2018 7 · Jelena Diakonikolas, Lorenzo Orecchia

Block-coordinate descent algorithms and alternating minimization methods are fundamental optimization algorithms and an important primitive in large-scale optimization and machine learning. While various block-coord…

Analysis of Distributed Stochastic Dual Coordinate Ascent

2013-12-04 · Tianbao Yang, Shenghuo Zhu, Rong Jin, Yuanqing Lin

In \citep{Yangnips13}, the author presented distributed stochastic dual coordinate ascent (DisDCA) algorithms for solving large-scale regularized loss minimization. Extraordinary performances have been observed and repor…

Fast convergence of the Expectation Maximization algorithm under a logarithmic Sobolev inequality

2024-07-25 · Rocco Caprio, Adam M Johansen

By utilizing recently developed tools for constructing gradient flows on Wasserstein spaces, we extend an analysis technique commonly employed to understand alternating minimization algorithms on Euclidean space to the E…

A Parallel Best-Response Algorithm with Exact Line Search for Nonconvex Sparsity-Regularized Rank Minimization

2017-11-13 · Yang Yang, Marius Pesavento

In this paper, we propose a convergent parallel best-response algorithm with the exact line search for the nondifferentiable nonconvex sparsity-regularized rank minimization problem. On the one hand, it exhibits a faster…