paper-with-me

Papers

Mixed Robust/Average Submodular Partitioning: Fast Algorithms, Guarantees, and Applications

2015-12-01 · NeurIPS 2015 12 · Kai Wei, Rishabh K. Iyer, Shengjie Wang, Wenruo Bai, Jeff A. Bilmes

We investigate two novel mixed robust/average-case submodular data partitioning problems that we collectively call Submodular Partitioning. These problems generalize purely robust instances of the problem, namely max-min submodular fair allocation (SFA) and \emph{min-max submodular load balancing} (SLB), and also average-case instances, that is the submodular welfare problem (SWP) and submodular multiway partition (SMP). While the robust versions have been studied in the theory community, existing work has focused on tight approximation guarantees, and the resultant algorithms are not generally scalable to large real-world applications. This contrasts the average case instances, where most of the algorithms are scalable. In the present paper, we bridge this gap, by proposing several new algorithms (including greedy, majorization-minimization, minorization-maximization, and relaxation algorithms) that not only scale to large datasets but that also achieve theoretical approximation guarantees comparable to the state-of-the-art. We moreover provide new scalable algorithms that apply to additive combinations of the robust and average-case objectives. We show that these problems have many applications in machine learning (ML), including data partitioning and load balancing for distributed ML, data clustering, and image segmentation. We empirically demonstrate the efficacy of our algorithms on real-world problems involving data partitioning for distributed optimization (of convex and deep neural network objectives), and also purely unsupervised image segmentation.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDistributed OptimizationImage SegmentationSemantic SegmentationUnsupervised Image Segmentation

Similar Papers 제목 키워드 기반

Mixed Robust/Average Submodular Partitioning: Fast Algorithms, Guarantees, and Applications to Parallel Machine Learning and Multi-Label Image Segmentation

2015-10-29 · NeurIPS 2015 · Kai Wei, Rishabh Iyer, Shengjie Wang, Wenruo Bai 외

We study two mixed robust/average-case submodular partitioning problems that we collectively call Submodular Partitioning. These problems generalize both purely robust instances of the problem (namely max-min submodular …

ClusteringDistributed OptimizationImage SegmentationInteractive Segmentation+2

Constrained Interacting Submodular Groupings

2018-07-01 · ICML 2018 7 · Andrew Cotter, Mahdi Milani Fard, Seungil You, Maya Gupta 외

We introduce the problem of grouping a finite ground set into blocks where each block is a subset of the ground set and where: (i) the blocks are individually highly valued by a submodular function (both robustly an…

Diversity

Constrained Robust Submodular Partitioning

2021-12-01 · NeurIPS 2021 12 · Shengjie Wang, Tianyi Zhou, Chandrashekhar Lavania, Jeff A. Bilmes

In the robust submodular partitioning problem, we aim to allocate a set of items into $m$ blocks, so that the evaluation of the minimum block according to a submodular function is maximized. Robust submodular partitionin…

RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning

2022-11-02 · Haoze He, Parijat Dube

The convergence of SGD based distributed training algorithms is tied to the data distribution across workers. Standard partitioning techniques try to achieve equal-sized partitions with per-class population distribution …

Submodularity In Machine Learning and Artificial Intelligence

2022-01-31 · Jeff Bilmes

In this manuscript, we offer a gentle review of submodularity and supermodularity and their properties. We offer a plethora of submodular definitions; a full description of a number of example submodular functions and th…

Abstractive Text SummarizationBIG-bench Machine Learningfeature selection