paper-with-me

Papers

Nuances in Margin Conditions Determine Gains in Active Learning

2021-10-16 · Samory Kpotufe, Gan Yuan, Yunfan Zhao

We consider nonparametric classification with smooth regression functions, where it is well known that notions of margin in $E[Y|X]$ determine fast or slow rates in both active and passive learning. Here we elucidate a striking distinction between the two settings. Namely, we show that some seemingly benign nuances in notions of margin -- involving the uniqueness of the Bayes classifier, and which have no apparent effect on rates in passive learning -- determine whether or not any active learner can outperform passive learning rates. In particular, for Audibert-Tsybakov's margin condition (allowing general situations with non-unique Bayes classifiers), no active learner can gain over passive learning in commonly studied settings where the marginal on $X$ is near uniform. Our results thus negate the usual intuition from past literature that active rates should improve over passive rates in nonparametric settings.

📄 PDF Abstract BibTeX arXiv:2110.08418

Code (0)

등록된 구현이 없습니다.

Tasks

Active Learning

Similar Papers 제목 키워드 기반

Operational modal analysis of under-determined system based on Bayesian CP decomposition

2023-11-09 · Sunao Tomita, Tomohiko Jimbo

Modal parameters such as natural frequencies, modal shapes, and the damping ratio are useful to understand structural dynamics of mechanical systems. Modal parameters need to be estimated under operational conditions for…

Bayesian InferenceStructural Health Monitoring

The Role of Binance in Bitcoin Volatility Transmission

2021-07-01 · Carol Alexander, Daniel Heck, Andreas Kaeck

We analyse high-frequency realised volatility dynamics and spillovers in the bitcoin market, focusing on two pairs: bitcoin against the US dollar (the main fiat-crypto pair) and trading bitcoin against tether (the main c…

A small-gain theorem for 2-contraction of nonlinear interconnected systems

2023-05-04 · David Angeli, Davide Martini, Giacomo Innocenti, Alberto Tesi

This paper introduces small-gain sufficient conditions for $2$-contraction of feedback interconnected systems, on the basis of individual gains of suitable subsystems arising from a modular decomposition of the second ad…

Conditions for Unnecessary Logical Constraints in Kernel Machines

2019-08-31 · Francesco Giannini, Marco Maggini

A main property of support vector machines consists in the fact that only a small portion of the training data is significant to determine the maximum margin separating hyperplane in the feature space, the so called supp…

Anti-Inpainting: A Proactive Defense against Malicious Diffusion-based Inpainters under Unknown Conditions

2025-05-19 · Yimao Guo, Zuomin Qu, Wei Lu, Xiangyang Luo

As diffusion-based malicious image manipulation becomes increasingly prevalent, multiple proactive defense methods are developed to safeguard images against unauthorized tampering. However, most proactive defense methods…

Data AugmentationDenoisingImage Manipulation