paper-with-me

홈 › Papers

Parallel Distributed Block Coordinate Descent Methods based on Pairwise Comparison Oracle

2014-09-13 · Kota Matsui, Wataru Kumagai, Takafumi Kanamori

This paper provides a block coordinate descent algorithm to solve unconstrained optimization problems. In our algorithm, computation of function values or gradients is not required. Instead, pairwise comparison of function values is used. Our algorithm consists of two steps; one is the direction estimate step and the other is the search step. Both steps require only pairwise comparison of function values, which tells us only the order of function values over two points. In the direction estimate step, a Newton type search direction is estimated. A computation method like block coordinate descent methods is used with the pairwise comparison. In the search step, a numerical solution is updated along the estimated direction. The computation in the direction estimate step can be easily parallelized, and thus, the algorithm works efficiently to find the minimizer of the objective function. Also, we show an upper bound of the convergence rate. In numerical experiments, we show that our method efficiently finds the optimal solution compared to some existing methods based on the pairwise comparison.

📄 PDF Abstract BibTeX arXiv:1409.3912

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Coordinate Descent with Arbitrary Sampling I: Algorithms and Complexity

2014-12-27 · Zheng Qu, Peter Richtárik

We study the problem of minimizing the sum of a smooth convex function and a convex block-separable regularizer and propose a new randomized coordinate descent method, which we call ALPHA. Our method at every iteration u…

Parallel Direction Method of Multipliers

2014-12-01 · NeurIPS 2014 12 · Huahua Wang, Arindam Banerjee, Zhi-Quan Luo

We consider the problem of minimizing block-separable convex functions subject to linear constraints. While the Alternating Direction Method of Multipliers (ADMM) for two-block linear constraints has been intensively stu…

Stochastic Parallel Block Coordinate Descent for Large-scale Saddle Point Problems

2015-11-23 · Zhanxing Zhu, Amos J. Storkey

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which …

feature selection

Asynchronous Parallel Incremental Block-Coordinate Descent for Decentralized Machine Learning

2022-02-07 · Hao Chen, Yu Ye, Ming Xiao, Mikael Skoglund

Machine learning (ML) is a key technique for big-data-driven modelling and analysis of massive Internet of Things (IoT) based intelligent and ubiquitous computing. For fast-increasing applications and data amounts, distr…

BIG-bench Machine Learning

Large Scale Kernel Learning using Block Coordinate Descent

2016-02-17 · Stephen Tu, Rebecca Roelofs, Shivaram Venkataraman, Benjamin Recht

We demonstrate that distributed block coordinate descent can quickly solve kernel regression and classification problems with millions of data points. Armed with this capability, we conduct a thorough comparison between …

ClassificationGeneral Classificationregression