paper-with-me

홈 › Papers

Transductive Active Learning: Theory and Applications

2024-02-13 · Jonas Hübotter, Bhavya Sukhija, Lenart Treven, Yarden As, Andreas Krause

We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We analyze a family of decision rules that sample adaptively to minimize uncertainty about prediction targets. We are the first to show, under general regularity assumptions, that such decision rules converge uniformly to the smallest possible uncertainty obtainable from the accessible data. We demonstrate their strong sample efficiency in two key applications: active fine-tuning of large neural networks and safe Bayesian optimization, where they achieve state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2402.15898

Code (2)

jonhue/activeft pytorch
jonhue/transductive-active-learning jax

Tasks

Active LearningBayesian OptimizationLearning TheoryPredictionTransductive Learning

Similar Papers 제목 키워드 기반

Localized Complexities for Transductive Learning

2014-11-26 · Ilya Tolstikhin, Gilles Blanchard, Marius Kloft

We show two novel concentration inequalities for suprema of empirical processes when sampling without replacement, which both take the variance of the functions into account. While these inequalities may potentially have…

Learning TheoryTransductive Learning

Analyzing Data Selection Techniques with Tools from the Theory of Information Losses

2019-02-25 · Brandon Foggo, Nanpeng Yu

In this paper, we present and illustrate some new tools for rigorously analyzing training data selection methods. These tools focus on the information theoretic losses that occur when sampling data. We use this framework…

Active LearningExperimental DesignGeneral ClassificationLearning Theory

Information-Theoretic Generalization Bounds for Transductive Learning and its Applications

2023-11-08 · Huayi Tang, Yong liu

In this paper, we establish generalization bounds for transductive learning algorithms in the context of information theory and PAC-Bayes, covering both the random sampling and the random splitting setting. First, we sho…

Generalization BoundsGraph LearningInductive LearningTransductive Learning

Permutational Rademacher Complexity: a New Complexity Measure for Transductive Learning

2015-05-12 · Ilya Tolstikhin, Nikita Zhivotovskiy, Gilles Blanchard

Transductive learning considers situations when a learner observes $m$ labelled training points and $u$ unlabelled test points with the final goal of giving correct answers for the test points. This paper introduces a ne…

Learning TheoryTransductive Learning

Learning Functional Transduction

2023-02-01 · NeurIPS 2023 11

Research in machine learning has polarized into two general approaches for regression tasks: Transductive methods construct estimates directly from available data but are usually problem unspecific. Inductive methods can…

regression