paper-with-me

Papers

Submodular Maximization via Gradient Ascent: The Case of Deep Submodular Functions

2018-12-01 · NeurIPS 2018 12 · Wenruo Bai, William Stafford Noble, Jeff A. Bilmes

We study the problem of maximizing deep submodular functions (DSFs) subject to a matroid constraint. DSFs are an expressive class of submodular functions that include, as strict subfamilies, the facility location, weighted coverage, and sums of concave composed with modular functions. We use a strategy similar to the continuous greedy approach, but we show that the multilinear extension of any DSF has a natural and computationally attainable concave relaxation that we can optimize using gradient ascent. Our results show a guarantee of $\max_{0<\delta<1}(1-\epsilon-\delta-e^{-\delta^2\Omega(k)})$ with a running time of $O(\nicefrac{n^2}{\epsilon^2})$ plus time for pipage rounding to recover a discrete solution, where $k$ is the rank of the matroid constraint. This bound is often better than the standard $1-1/e$ guarantee of the continuous greedy algorithm, but runs much faster. Our bound also holds even for fully curved ($c=1$) functions where the guarantee of $1-c/e$ degenerates to $1-1/e$ where $c$ is the curvature of $f$. We perform computational experiments that support our theoretical results.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Stochastic Submodular Maximization: The Case of Coverage Functions

2017-11-05 · NeurIPS 2017 12 · Mohammad Reza Karimi, Mario Lucic, Hamed Hassani, Andreas Krause

Stochastic optimization of continuous objectives is at the heart of modern machine learning. However, many important problems are of discrete nature and often involve submodular objectives. We seek to unleash the power o…

ClusteringStochastic Optimization

Stochastic Conditional Gradient Methods: From Convex Minimization to Submodular Maximization

2018-04-24 · Aryan Mokhtari, Hamed Hassani, Amin Karbasi

This paper considers stochastic optimization problems for a large class of objective functions, including convex and continuous submodular. Stochastic proximal gradient methods have been widely used to solve such problem…

Stochastic Optimization

Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization

2022-08-18 · Qixin Zhang, Zengde Deng, Xiangru Jian, Zaiyi Chen 외

Maximizing a monotone submodular function is a fundamental task in machine learning, economics, and statistics. In this paper, we present two communication-efficient decentralized online algorithms for the monotone conti…

Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious Function

2022-01-03 · Qixin Zhang, Zengde Deng, Zaiyi Chen, Haoyuan Hu 외

In this paper, we revisit Stochastic Continuous Submodular Maximization in both offline and online settings, which can benefit wide applications in machine learning and operations research areas. We present a boosting fr…

Fast First-Order Methods for Monotone Strongly DR-Submodular Maximization

2021-11-15 · Omid Sadeghi, Maryam Fazel

Continuous DR-submodular functions are a class of functions that satisfy the Diminishing Returns (DR) property, which implies that they are concave along non-negative directions. Existing works have studied monotone cont…