paper-with-me

Papers

GreedyML: A Parallel Algorithm for Maximizing Constrained Submodular Functions

2024-03-15 · Shivaram Gopal, S M Ferdous, Hemanta K. Maji, Alex Pothen

We describe a parallel approximation algorithm for maximizing monotone submodular functions subject to hereditary constraints on distributed memory multiprocessors. Our work is motivated by the need to solve submodular optimization problems on massive data sets, for practical contexts such as data summarization, machine learning, and graph sparsification. Our work builds on the randomized distributed RandGreedi algorithm, proposed by Barbosa, Ene, Nguyen, and Ward (2015). This algorithm computes a distributed solution by randomly partitioning the data among all the processors and then employing \emph{a single} accumulation step in which all processors send their partial solutions to one processor. However, for large problems, the accumulation step exceeds the memory available on a processor, and the processor that performs the accumulation becomes a computational bottleneck. Hence we propose a generalization of the RandGreedi algorithm that employs multiple accumulation steps to reduce the memory required. We analyze the approximation ratio and the time complexity of the algorithm (in the BSP model). We evaluate the new GreedyML algorithm on three classes of problems, and report results from large-scale data sets with millions of elements. The results show that the GreedyML algorithm can solve problems where the sequential Greedy and distributed RandGreedi algorithms fail due to memory constraints. For certain computationally intensive problems, the GreedyML algorithm is faster than the RandGreedi algorithm. The observed approximation quality of the solutions computed by the GreedyML algorithm closely matches those obtained by the RandGreedi algorithm on these problems.

📄 PDF Abstract BibTeX arXiv:2403.10332

Code (0)

등록된 구현이 없습니다.

Tasks

Data Summarization

Similar Papers 제목 키워드 기반

A Parallel Double Greedy Algorithm for Submodular Maximization

2018-12-04 · Alina Ene, Huy L. Nguyen, Adrian Vladu

We study parallel algorithms for the problem of maximizing a non-negative submodular function. Our main result is an algorithm that achieves a nearly-optimal $1/2 -\epsilon$ approximation using $O(\log(1/\epsilon) / \eps…

Maximizing Non-Monotone DR-Submodular Functions with Cardinality Constraints

2016-11-29 · Ali Khodabakhsh, Evdokia Nikolova

We consider the problem of maximizing a non-monotone DR-submodular function subject to a cardinality constraint. Diminishing returns (DR) submodularity is a generalization of the diminishing returns property for function…

BIG-bench Machine LearningCombinatorial Optimization

Parallel Double Greedy Submodular Maximization

2014-12-01 · NeurIPS 2014 12 · Xinghao Pan, Stefanie Jegelka, Joseph E. Gonzalez, Joseph K. Bradley 외

Many machine learning problems can be reduced to the maximization of submodular functions. Although well understood in the serial setting, the parallel maximization of submodular functions remains an open area of researc…

Submodular Optimization with Submodular Cover and Submodular Knapsack Constraints

2013-12-01 · NeurIPS 2013 12 · Rishabh K. Iyer, Jeff A. Bilmes

We investigate two new optimization problems — minimizing a submodular function subject to a submodular lower bound constraint (submodular cover) and maximizing a submodular function subject to a submodular upper bound c…

Diversity

Submodular Optimization with Submodular Cover and Submodular Knapsack Constraints

2013-11-08 · NeurIPS 2013 · Rishabh Iyer, Jeff Bilmes

We investigate two new optimization problems -- minimizing a submodular function subject to a submodular lower bound constraint (submodular cover) and maximizing a submodular function subject to a submodular upper bound …

Diversity