Learning in Confusion: Batch Active Learning with Noisy Oracle
We study the problem of training machine learning models incrementally using active learning with access to imperfect or noisy oracles. We specifically consider the setting of batch active learning, in which multiple samples are selected as opposed to a single sample as in classical settings so as to reduce the training overhead. Our approach bridges between uniform randomness and score based importance sampling of clusters when selecting a batch of new samples. Experiments on benchmark image classification datasets (MNIST, SVHN, and CIFAR10) shows improvement over existing active learning strategies. We introduce an extra denoising layer to deep networks to make active learning robust to label noises and show significant improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningDenoisingimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Noisy Batch Active Learning with Deterministic Annealing
We study the problem of training machine learning models incrementally with batches of samples annotated with noisy oracles. We select each batch of samples that are important and also diverse via clustering and importan…
Active LearningClusteringDenoisingimage-classification+1Fast Rates in Pool-Based Batch Active Learning
We consider a batch active learning scenario where the learner adaptively issues batches of points to a labeling oracle. Sampling labels in batches is highly desirable in practice due to the smaller number of interactive…
Active LearningDiversityInformativenessQActor: On-line Active Learning for Noisy Labeled Stream Data
Noisy labeled data is more a norm than a rarity for self-generated content that is continuously published on the web and social media. Due to privacy concerns and governmental regulations, such a data stream can only be …
Active LearningNon-asymptotic bounds for stochastic optimization with biased noisy gradient oracles
We introduce biased gradient oracles to capture a setting where the function measurements have an estimation error that can be controlled through a batch size parameter. Our proposed oracles are appealing in several prac…
Stochastic OptimizationReducing Confusion in Active Learning for Part-Of-Speech Tagging
Active learning (AL) uses a data selection algorithm to select useful training samples to minimize annotation cost. This is now an essential tool for building low-resource syntactic analyzers such as part-of-speech (POS)…
Active LearningPart-Of-Speech TaggingPOS