paper-with-me

Papers

Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyond

2021-10-27 · NeurIPS 2021 12 · Đ. Khuê Lê-Huu, Karteek Alahari

We introduce regularized Frank-Wolfe, a general and effective algorithm for inference and learning of dense conditional random fields (CRFs). The algorithm optimizes a nonconvex continuous relaxation of the CRF inference problem using vanilla Frank-Wolfe with approximate updates, which are equivalent to minimizing a regularized energy function. Our proposed method is a generalization of existing algorithms such as mean field or concave-convex procedure. This perspective not only offers a unified analysis of these algorithms, but also allows an easy way of exploring different variants that potentially yield better performance. We illustrate this in our empirical results on standard semantic segmentation datasets, where several instantiations of our regularized Frank-Wolfe outperform mean field inference, both as a standalone component and as an end-to-end trainable layer in a neural network. We also show that dense CRFs, coupled with our new algorithms, produce significant improvements over strong CNN baselines.

📄 PDF Abstract BibTeX arXiv:2110.14759

Code (1)

netw0rkf10w/crf 공식 구현 pytorch

Tasks

Semantic Segmentation

Methods 이 논문이 사용한 방법론

CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…

Similar Papers 제목 키워드 기반

Stochastic In-Face Frank-Wolfe Methods for Non-Convex Optimization and Sparse Neural Network Training

2019-06-09 · Paul Grigas, Alfonso Lobos, Nathan Vermeersch

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that c…

Primal-Dual Block Frank-Wolfe

2019-06-06 · Qi Lei, Jiacheng Zhuo, Constantine Caramanis, Inderjit S. Dhillon 외

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Pr…

General ClassificationMulti-class ClassificationRetrieval

Primal-Dual Block Generalized Frank-Wolfe

2019-12-01 · NeurIPS 2019 12 · Qi Lei, Jiacheng Zhuo, Constantine Caramanis, Inderjit S. Dhillon 외

We propose a generalized variant of Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The pro…

Multi-class ClassificationRetrieval

Efficient Relaxations for Dense CRFs with Sparse Higher Order Potentials

2018-05-23 · Thomas Joy, Alban Desmaison, Thalaiyasingam Ajanthan, Rudy Bunel 외

Dense conditional random fields (CRFs) have become a popular framework for modelling several problems in computer vision such as stereo correspondence and multi-class semantic segmentation. By modelling long-range intera…

Semantic Segmentation

Efficient Continuous Relaxations for Dense CRF

2016-08-22 · Alban Desmaison, Rudy Bunel, Pushmeet Kohli, Philip H. S. Torr 외

Dense conditional random fields (CRF) with Gaussian pairwise potentials have emerged as a popular framework for several computer vision applications such as stereo correspondence and semantic segmentation. By modeling lo…

Semantic SegmentationVariational Inference