MCDAL: Maximum Classifier Discrepancy for Active Learning
Recent state-of-the-art active learning methods have mostly leveraged Generative Adversarial Networks (GAN) for sample acquisition; however, GAN is usually known to suffer from instability and sensitivity to hyper-parameters. In contrast to these methods, we propose in this paper a novel active learning framework that we call Maximum Classifier Discrepancy for Active Learning (MCDAL) which takes the prediction discrepancies between multiple classifiers. In particular, we utilize two auxiliary classification layers that learn tighter decision boundaries by maximizing the discrepancies among them. Intuitively, the discrepancies in the auxiliary classification layers' predictions indicate the uncertainty in the prediction. In this regard, we propose a novel method to leverage the classifier discrepancies for the acquisition function for active learning. We also provide an interpretation of our idea in relation to existing GAN based active learning methods and domain adaptation frameworks. Moreover, we empirically demonstrate the utility of our approach where the performance of our approach exceeds the state-of-the-art methods on several image classification and semantic segmentation datasets in active learning setups.
Code (1)
Tasks
Active LearningClassificationDomain Adaptationimage-classificationImage ClassificationSemantic SegmentationSimilar Papers 제목 키워드 기반
Unsupervised domain adaptation using feature aligned maximum classifier discrepancy
The maximum classifier discrepancy method has achieved great success in solving unsupervised domain adaptation tasks for image classification in recent years. Its basic structure consists of a feature generator and two c…
Domain Adaptationimage-classificationUnsupervised Domain AdaptationClassification Committee for Active Deep Object Detection
In object detection, the cost of labeling is much high because it needs not only to confirm the categories of multiple objects in an image but also to accurately determine the bounding boxes of each object. Thus, integra…
Active LearningClassificationObjectobject-detection+1Multiple Classifiers Based Maximum Classifier Discrepancy for Unsupervised Domain Adaptation
Adversarial training based on the maximum classifier discrepancy between two classifier structures has achieved great success in unsupervised domain adaptation tasks for image classification. The approach adopts the stru…
Domain Adaptationimage-classificationImage ClassificationUnsupervised Domain AdaptationNuclear Discrepancy for Active Learning
Active learning algorithms propose which unlabeled objects should be queried for their labels to improve a predictive model the most. We study active learners that minimize generalization bounds and uncover relationships…
Active LearningGeneralization BoundsNearest Neighbor Classifier with Margin Penalty for Active Learning
As deep learning becomes the mainstream in the field of natural language processing, the need for suitable active learning method are becoming unprecedented urgent. Active Learning (AL) methods based on nearest neighbor …
Active Learning