paper-with-me

Papers

Batch Active Learning Using Determinantal Point Processes

2019-06-19 · Erdem Biyik, Kenneth Wang, Nima Anari, Dorsa Sadigh

Data collection and labeling is one of the main challenges in employing machine learning algorithms in a variety of real-world applications with limited data. While active learning methods attempt to tackle this issue by labeling only the data samples that give high information, they generally suffer from large computational costs and are impractical in settings where data can be collected in parallel. Batch active learning methods attempt to overcome this computational burden by querying batches of samples at a time. To avoid redundancy between samples, previous works rely on some ad hoc combination of sample quality and diversity. In this paper, we present a new principled batch active learning method using Determinantal Point Processes, a repulsive point process that enables generating diverse batches of samples. We develop tractable algorithms to approximate the mode of a DPP distribution, and provide theoretical guarantees on the degree of approximation. We further demonstrate that an iterative greedy method for DPP maximization, which has lower computational costs but worse theoretical guarantees, still gives competitive results for batch active learning. Our experiments show the value of our methods on several datasets against state-of-the-art baselines.

📄 PDF Abstract BibTeX arXiv:1906.07975

Code (1)

Stanford-ILIAD/DPP-Batch-Active-Learning 공식 구현

Tasks

Active LearningDiversityPoint Processes

Similar Papers 제목 키워드 기반

Active Mini-Batch Sampling using Repulsive Point Processes

2018-04-08 · Cheng Zhang, Cengiz Öztireli, Stephan Mandt, Giampiero Salvi

The convergence speed of stochastic gradient descent (SGD) can be improved by actively selecting mini-batches. We explore sampling schemes where similar data points are less likely to be selected in the same mini-batch. …

Point Processes

Diversified Sampling for Batched Bayesian Optimization with Determinantal Point Processes

2021-10-22 · Elvis Nava, Mojmír Mutný, Andreas Krause

In Bayesian Optimization (BO) we study black-box function optimization with noisy point evaluations and Bayesian priors. Convergence of BO can be greatly sped up by batching, where multiple evaluations of the black-box f…

Bayesian OptimizationDiversityPoint ProcessesThompson Sampling

Determinantal Point Processes for Mini-Batch Diversification

2017-05-01 · Cheng Zhang, Hedvig Kjellstrom, Stephan Mandt

We study a mini-batch diversification scheme for stochastic gradient descent (SGD). While classical SGD relies on uniformly sampling data points to form a mini-batch, we propose a non-uniform sampling scheme based on the…

Point Processes

Batch Active Learning of Reward Functions from Human Preferences

2024-02-24 · Erdem Biyik, Nima Anari, Dorsa Sadigh

Data generation and labeling are often expensive in robot learning. Preference-based learning is a concept that enables reliable labeling by querying users with preference questions. Active querying methods are commonly …

Active LearningPoint Processes

Diversity-Aware Batch Active Learning for Dependency Parsing

2021-04-28 · NAACL 2021 4 · Tianze Shi, Adrian Benton, Igor Malioutov, Ozan İrsoy

While the predictive performance of modern statistical dependency parsers relies heavily on the availability of expensive expert-annotated treebank data, not all annotations contribute equally to the training of the pars…

Active LearningDependency ParsingDiversityPoint Processes