Nuances in Margin Conditions Determine Gains in Active Learning
We consider nonparametric classification with smooth regression functions, where it is well known that notions of margin in $E[Y|X]$ determine fast or slow rates in both active and passive learning. Here we elucidate a striking distinction between the two settings. Namely, we show that some seemingly benign nuances in notions of margin -- involving the uniqueness of the Bayes classifier, and which have no apparent effect on rates in passive learning -- determine whether or not any active learner can outperform passive learning rates. In particular, for Audibert-Tsybakov's margin condition (allowing general situations with non-unique Bayes classifiers), no active learner can gain over passive learning in commonly studied settings where the marginal on $X$ is near uniform. Our results thus negate the usual intuition from past literature that active rates should improve over passive rates in nonparametric settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningSimilar Papers 제목 키워드 기반
Operational modal analysis of under-determined system based on Bayesian CP decomposition
Modal parameters such as natural frequencies, modal shapes, and the damping ratio are useful to understand structural dynamics of mechanical systems. Modal parameters need to be estimated under operational conditions for…
Bayesian InferenceStructural Health MonitoringThe Role of Binance in Bitcoin Volatility Transmission
We analyse high-frequency realised volatility dynamics and spillovers in the bitcoin market, focusing on two pairs: bitcoin against the US dollar (the main fiat-crypto pair) and trading bitcoin against tether (the main c…
A small-gain theorem for 2-contraction of nonlinear interconnected systems
This paper introduces small-gain sufficient conditions for $2$-contraction of feedback interconnected systems, on the basis of individual gains of suitable subsystems arising from a modular decomposition of the second ad…
Conditions for Unnecessary Logical Constraints in Kernel Machines
A main property of support vector machines consists in the fact that only a small portion of the training data is significant to determine the maximum margin separating hyperplane in the feature space, the so called supp…
Anti-Inpainting: A Proactive Defense against Malicious Diffusion-based Inpainters under Unknown Conditions
As diffusion-based malicious image manipulation becomes increasingly prevalent, multiple proactive defense methods are developed to safeguard images against unauthorized tampering. However, most proactive defense methods…
Data AugmentationDenoisingImage Manipulation