paper-with-me

홈 › Papers

A Multi-Plane Block-Coordinate Frank-Wolfe Algorithm for Training Structural SVMs with a Costly max-Oracle

2014-08-28 · CVPR 2015 6 · Neel Shah, Vladimir Kolmogorov, Christoph H. Lampert

Structural support vector machines (SSVMs) are amongst the best performing models for structured computer vision tasks, such as semantic image segmentation or human pose estimation. Training SSVMs, however, is computationally costly, because it requires repeated calls to a structured prediction subroutine (called \emph{max-oracle}), which has to solve an optimization problem itself, e.g. a graph cut. In this work, we introduce a new algorithm for SSVM training that is more efficient than earlier techniques when the max-oracle is computationally expensive, as it is frequently the case in computer vision tasks. The main idea is to (i) combine the recent stochastic Block-Coordinate Frank-Wolfe algorithm with efficient hyperplane caching, and (ii) use an automatic selection rule for deciding whether to call the exact max-oracle or to rely on an approximate one based on the cached hyperplanes. We show experimentally that this strategy leads to faster convergence to the optimum with respect to the number of requires oracle calls, and that this translates into faster convergence with respect to the total runtime when the max-oracle is slow compared to the other steps of the algorithm. A publicly available C++ implementation is provided at http://pub.ist.ac.at/~vnk/papers/SVM.html .

📄 PDF Abstract BibTeX arXiv:1408.6804

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationPose EstimationSemantic SegmentationStructured Prediction

Similar Papers 제목 키워드 기반

MAP inference via Block-Coordinate Frank-Wolfe Algorithm

2018-06-13 · CVPR 2019 6 · Paul Swoboda, Vladimir Kolmogorov

We present a new proximal bundle method for Maximum-A-Posteriori (MAP) inference in structured energy minimization problems. The method optimizes a Lagrangean relaxation of the original energy minimization problem using …

Graph Matching

Stochastic In-Face Frank-Wolfe Methods for Non-Convex Optimization and Sparse Neural Network Training

2019-06-09 · Paul Grigas, Alfonso Lobos, Nathan Vermeersch

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that c…

Parallel and Distributed Block-Coordinate Frank-Wolfe Algorithms

2014-09-22 · Yu-Xiang Wang, Veeranjaneyulu Sadhanala, Wei Dai, Willie Neiswanger 외

We develop parallel and distributed Frank-Wolfe algorithms; the former on shared memory machines with mini-batching, and the latter in a delayed update framework. Whenever possible, we perform computations asynchronously…

Minding the Gaps for Block Frank-Wolfe Optimization of Structured SVMs

2016-05-30 · Anton Osokin, Jean-Baptiste Alayrac, Isabella Lukasewitz, Puneet K. Dokania 외

In this paper, we propose several improvements on the block-coordinate Frank-Wolfe (BCFW) algorithm from Lacoste-Julien et al. (2013) recently used to optimize the structured support vector machine (SSVM) objective in th…

Structured Prediction

Primal-Dual Block Frank-Wolfe

2019-06-06 · Qi Lei, Jiacheng Zhuo, Constantine Caramanis, Inderjit S. Dhillon 외

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Pr…

General ClassificationMulti-class ClassificationRetrieval