Minority Class Oriented Active Learning for Imbalanced Datasets
Active learning aims to optimize the dataset annotation process when resources are constrained. Most existing methods are designed for balanced datasets. Their practical applicability is limited by the fact that a majority of real-life datasets are actually imbalanced. Here, we introduce a new active learning method which is designed for imbalanced datasets. It favors samples likely to be in minority classes so as to reduce the imbalance of the labeled subset and create a better representation for these classes. We also compare two training schemes for active learning: (1) the one commonly deployed in deep active learning using model fine tuning for each iteration and (2) a scheme which is inspired by transfer learning and exploits generic pre-trained models and train shallow classifiers for each iteration. Evaluation is run with three imbalanced datasets. Results show that the proposed active learning method outperforms competitive baselines. Equally interesting, they also indicate that the transfer learning training scheme outperforms model fine tuning if features are transferable from the generic dataset to the unlabeled one. This last result is surprising and should encourage the community to explore the design of deep active learning methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningTransfer LearningSimilar Papers 제목 키워드 기반
AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets
Active learning for imbalanced classification tasks is challenging as the minority classes naturally occur rarely. Gathering a large pool of unlabelled data is thus essential to capture minority instances. Standard pool-…
Active Learningimbalanced classificationHow to train your draGAN: A task oriented solution to imbalanced classification
The long-standing challenge of building effective classification models for small and imbalanced datasets has seen little improvement since the creation of the Synthetic Minority Over-sampling Technique (SMOTE) over 20 y…
imbalanced classificationAdaptive kernel-density approach for imbalanced binary classification
Class imbalance is a common challenge in real-world binary classification tasks, often leading to predictions biased toward the majority class and reduced recognition of the minority class. This issue is particularly cri…
Binary ClassificationDensity EstimationAnomaly DetectionMedical DiagnosisActive Label Refinement for Robust Training of Imbalanced Medical Image Classification Tasks in the Presence of High Label Noise
The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence …
Active LearningClassificationimage-classificationImage Classification+2GenSample: A Genetic Algorithm for Oversampling in Imbalanced Datasets
Imbalanced datasets are ubiquitous. Classification performance on imbalanced datasets is generally poor for the minority class as the classifier cannot learn decision boundaries well. However, in sensitive applications l…
Fraud DetectionMedical Diagnosis