paper-with-me

Papers

A Memoization Framework for Scaling Submodular Optimization to Large Scale Problems

2019-02-26 · Rishabh Iyer, Jeff Bilmes

We are motivated by large scale submodular optimization problems, where standard algorithms that treat the submodular functions in the \emph{value oracle model} do not scale. In this paper, we present a model called the \emph{precomputational complexity model}, along with a unifying memoization based framework, which looks at the specific form of the given submodular function. A key ingredient in this framework is the notion of a \emph{precomputed statistic}, which is maintained in the course of the algorithms. We show that we can easily integrate this idea into a large class of submodular optimization problems including constrained and unconstrained submodular maximization, minimization, difference of submodular optimization, optimization with submodular constraints and several other related optimization problems. Moreover, memoization can be integrated in both discrete and continuous relaxation flavors of algorithms for these problems. We demonstrate this idea for several commonly occurring submodular functions, and show how the precomputational model provides significant speedups compared to the value oracle model. Finally, we empirically demonstrate this for large scale machine learning problems of data subset selection and summarization.

📄 PDF Abstract BibTeX arXiv:1902.10176

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Formal Perspective on Byte-Pair Encoding

2023-06-29 · Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du 외

Byte-Pair Encoding (BPE) is a popular algorithm used for tokenizing data in NLP, despite being devised initially as a compression method. BPE appears to be a greedy algorithm at face value, but the underlying optimizatio…

Combinatorial Optimization

Scaling Submodular Optimization Approaches for Control Applications in Networked Systems

2018-10-05 · Arun V. Sathanur

Often times, in many design problems, there is a need to select a small set of informative or representative elements from a large ground set of entities in an optimal fashion. Submodular optimization that provides for a…

Bi-Criteria Optimization for Combinatorial Bandits: Sublinear Regret and Constraint Violation under Bandit Feedback

2025-03-15 · Vaneet Aggarwal, Shweta Jain, Subham Pokhriyal, Christopher John Quinn

In this paper, we study bi-criteria optimization for combinatorial multi-armed bandits (CMAB) with bandit feedback. We propose a general framework that transforms discrete bi-criteria offline approximation algorithms int…

Multi-Armed Bandits

Projection-Free Online Optimization with Stochastic Gradient: From Convexity to Submodularity

2018-02-22 · ICML 2018 7 · Lin Chen, Christopher Harshaw, Hamed Hassani, Amin Karbasi

Online optimization has been a successful framework for solving large-scale problems under computational constraints and partial information. Current methods for online convex optimization require either a projection or …

How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions

2026-05-28 · Jeff A. Bilmes, Gantavya Bhatt, Arnav M. Das arxiv

Neural scaling laws appraise data through dataset size, while the Vendi Score uses quantum entropy to measure dataset value. We show both that common neural-scaling-law objectives and the Vendi Score are submodular. We f…