Semi-supervised Batch Active Learning via Bilevel Optimization
Active learning is an effective technique for reducing the labeling cost by improving data efficiency. In this work, we propose a novel batch acquisition strategy for active learning in the setting where the model training is performed in a semi-supervised manner. We formulate our approach as a data summarization problem via bilevel optimization, where the queried batch consists of the points that best summarize the unlabeled data pool. We show that our method is highly effective in keyword detection tasks in the regime when only few labeled samples are available.
Code (1)
Tasks
Active LearningBilevel OptimizationData SummarizationSimilar Papers 제목 키워드 기반
MetAL: Active Semi-Supervised Learning on Graphs via Meta Learning
The objective of active learning (AL) is to train classification models with less number of labeled instances by selecting only the most informative instances for labeling. The AL algorithms designed for other data types…
Active LearningBilevel OptimizationMeta-LearningLearning to Rank for Active Learning via Multi-Task Bilevel Optimization
Active learning is a promising paradigm to reduce the labeling cost by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition function …
Active LearningBilevel OptimizationLearning-To-RankAlternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimization
Stochastic bilevel optimization, which captures the inherent nested structure of machine learning problems, is gaining popularity in many recent applications. Existing works on bilevel optimization mostly consider either…
Bilevel OptimizationWhiteness-based bilevel learning of regularization parameters in imaging
We consider an unsupervised bilevel optimization strategy for learning regularization parameters in the context of imaging inverse problems in the presence of additive white Gaussian noise. Compared to supervised and sem…
Bilevel OptimizationImage DeconvolutionA Single-Timescale Method for Stochastic Bilevel Optimization
Stochastic bilevel optimization generalizes the classic stochastic optimization from the minimization of a single objective to the minimization of an objective function that depends the solution of another optimization p…
Bilevel OptimizationMeta-LearningStochastic Optimization