paper-with-me

홈 › Papers

Reflection methods for user-friendly submodular optimization

2013-11-18 · NeurIPS 2013 12 · Stefanie Jegelka, Francis Bach, Suvrit Sra

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedures for submodular functions, especially for minimization problems. While general submodular minimization is challenging, we propose a new method that exploits existing decomposability of submodular functions. In contrast to previous approaches, our method is neither approximate, nor impractical, nor does it need any cumbersome parameter tuning. Moreover, it is easy to implement and parallelize. A key component of our method is a formulation of the discrete submodular minimization problem as a continuous best approximation problem that is solved through a sequence of reflections, and its solution can be easily thresholded to obtain an optimal discrete solution. This method solves both the continuous and discrete formulations of the problem, and therefore has applications in learning, inference, and reconstruction. In our experiments, we illustrate the benefits of our method on two image segmentation tasks.

📄 PDF Abstract BibTeX arXiv:1311.4296

Code (0)

등록된 구현이 없습니다.

Tasks

Image SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Submodularity in Action: From Machine Learning to Signal Processing Applications

2020-06-17 · Ehsan Tohidi, Rouhollah Amiri, Mario Coutino, David Gesbert 외

Submodularity is a discrete domain functional property that can be interpreted as mimicking the role of the well-known convexity/concavity properties in the continuous domain. Submodular functions exhibit strong structur…

BIG-bench Machine Learning

Balancing Utility and Fairness in Submodular Maximization (Technical Report)

2022-11-02 · Yanhao Wang, Yuchen Li, Francesco Bonchi, Ying Wang

Submodular function maximization is a fundamental combinatorial optimization problem with plenty of applications -- including data summarization, influence maximization, and recommendation. In many of these problems, the…

Combinatorial OptimizationData SummarizationFairness

CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices

2020-04-18 · Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller

We introduce an efficient approach for optimization over orthogonal groups on highly parallel computation units such as GPUs or TPUs. As in earlier work, we parametrize an orthogonal matrix as a product of Householder re…

Machine TranslationTranslationVideo Prediction

Structured Convex Optimization under Submodular Constraints

2013-09-26 · Kiyohito Nagano, Yoshinobu Kawahara

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed gr…

BIG-bench Machine Learning

Decomposable Submodular Maximization in Federated Setting

2024-01-31 · Akbar Rafiey

Submodular functions, as well as the sub-class of decomposable submodular functions, and their optimization appear in a wide range of applications in machine learning, recommendation systems, and welfare maximization. Ho…

Recommendation Systems