paper-with-me

Papers

Optimal approximation for unconstrained non-submodular minimization

2019-05-29 · ICML 2020 1 · Marwa El Halabi, Stefanie Jegelka

Submodular function minimization is well studied, and existing algorithms solve it exactly or up to arbitrary accuracy. However, in many applications, such as structured sparse learning or batch Bayesian optimization, the objective function is not exactly submodular, but close. In this case, no theoretical guarantees exist. Indeed, submodular minimization algorithms rely on intricate connections between submodularity and convexity. We show how these relations can be extended to obtain approximation guarantees for minimizing non-submodular functions, characterized by how close the function is to submodular. We also extend this result to noisy function evaluations. Our approximation results are the first for minimizing non-submodular functions, and are optimal, as established by our matching lower bound.

📄 PDF Abstract BibTeX arXiv:1905.12145

Code (1)

marwash25/non-sub-min 공식 구현

Tasks

Bayesian OptimizationSparse Learning

Similar Papers 제목 키워드 기반

Online Nonsubmodular Minimization with Delayed Costs: From Full Information to Bandit Feedback

2022-05-15 · Tianyi Lin, Aldo Pacchiano, Yaodong Yu, Michael I. Jordan

Motivated by applications to online learning in sparse estimation and Bayesian optimization, we consider the problem of online unconstrained nonsubmodular minimization with delayed costs in both full information and band…

Bayesian Optimization

Curvature and Optimal Algorithms for Learning and Minimizing Submodular Functions

2013-11-08 · NeurIPS 2013 12 · Rishabh Iyer, Stefanie Jegelka, Jeff Bilmes

We investigate three related and important problems connected to machine learning: approximating a submodular function everywhere, learning a submodular function (in a PAC-like setting [53]), and constrained minimization…

Submodular Function Minimization and Polarity

2019-12-31 · Alper Atamturk, Vishnu Narayanan

Using polarity, we give an outer polyhedral approximation for the epigraph of set functions. For a submodular function, we prove that the corresponding polar relaxation is exact; hence, it is equivalent to the Lov\'asz e…

Reflection methods for user-friendly submodular optimization

2013-11-18 · NeurIPS 2013 12 · Stefanie Jegelka, Francis Bach, Suvrit Sra

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedure…

Image SegmentationSemantic Segmentation

Unconstrained Submodular Maximization with Constant Adaptive Complexity

2018-11-15 · Lin Chen, Moran Feldman, Amin Karbasi

In this paper, we consider the unconstrained submodular maximization problem. We propose the first algorithm for this problem that achieves a tight $(1/2-\varepsilon)$-approximation guarantee using $\tilde{O}(\varepsilon…