Transductive Active Learning: Theory and Applications
We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We analyze a family of decision rules that sample adaptively to minimize uncertainty about prediction targets. We are the first to show, under general regularity assumptions, that such decision rules converge uniformly to the smallest possible uncertainty obtainable from the accessible data. We demonstrate their strong sample efficiency in two key applications: active fine-tuning of large neural networks and safe Bayesian optimization, where they achieve state-of-the-art performance.
Code (2)
Tasks
Active LearningBayesian OptimizationLearning TheoryPredictionTransductive LearningSimilar Papers 제목 키워드 기반
Localized Complexities for Transductive Learning
We show two novel concentration inequalities for suprema of empirical processes when sampling without replacement, which both take the variance of the functions into account. While these inequalities may potentially have…
Learning TheoryTransductive LearningAnalyzing Data Selection Techniques with Tools from the Theory of Information Losses
In this paper, we present and illustrate some new tools for rigorously analyzing training data selection methods. These tools focus on the information theoretic losses that occur when sampling data. We use this framework…
Active LearningExperimental DesignGeneral ClassificationLearning TheoryInformation-Theoretic Generalization Bounds for Transductive Learning and its Applications
In this paper, we establish generalization bounds for transductive learning algorithms in the context of information theory and PAC-Bayes, covering both the random sampling and the random splitting setting. First, we sho…
Generalization BoundsGraph LearningInductive LearningTransductive LearningPermutational Rademacher Complexity: a New Complexity Measure for Transductive Learning
Transductive learning considers situations when a learner observes $m$ labelled training points and $u$ unlabelled test points with the final goal of giving correct answers for the test points. This paper introduces a ne…
Learning TheoryTransductive LearningLearning Functional Transduction
Research in machine learning has polarized into two general approaches for regression tasks: Transductive methods construct estimates directly from available data but are usually problem unspecific. Inductive methods can…
regression