Highly Efficient Representation and Active Learning Framework and Its Application to Imbalanced Medical Image Classification
We propose a highly data-efficient active learning framework for image classification. Our novel framework combines: (1) unsupervised representation learning of a Convolutional Neural Network and (2) the Gaussian Process (GP) method, in sequence to achieve highly data and label efficient classifications. Moreover, both elements are less sensitive to the prevalent and challenging class imbalance issue, thanks to the (1) feature learned without labels and (2) the Bayesian nature of GP. The GP-provided uncertainty estimates enable active learning by ranking samples based on the uncertainty and selectively labeling samples showing higher uncertainty. We apply this novel combination to the severely imbalanced case of COVID-19 chest X-ray classification and the Nerthus colonoscopy classification. We demonstrate that only . 10% of the labeled data is needed to reach the accuracy from training all available labels. We also applied our model architecture and proposed framework to a broader class of datasets with expected success.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningClassificationGeneral Classificationimage-classificationImage ClassificationMedical Image ClassificationRepresentation LearningX-ray ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Auto-encoder based Model for High-dimensional Imbalanced Industrial Data
With the proliferation of IoT devices, the distributed control systems are now capturing and processing more sensors at higher frequency than ever before. These new data, due to their volume and novelty, cannot be effect…
Representation LearningSensor ModelingVocal Bursts Intensity PredictionClass-Balanced and Reinforced Active Learning on Graphs
Graph neural networks (GNNs) have demonstrated significant success in various applications, such as node classification, link prediction, and graph classification. Active learning for GNNs aims to query the valuable samp…
Active LearningGraph ClassificationLink PredictionNode ClassificationRefining Decision Boundaries In Anomaly Detection Using Similarity Search Within the Feature Space
Detecting rare and diverse anomalies in highly imbalanced datasets-such as Advanced Persistent Threats (APTs) in cybersecurity-remains a fundamental challenge for machine learning systems. Active learning offers a promis…
Anomaly DetectionActive LearningImbalanced multi-label classification using multi-task learning with extractive summarization
Extractive summarization and imbalanced multi-label classification often require vast amounts of training data to avoid overfitting. In situations where training data is expensive to generate, leveraging information betw…
ClassificationExtractive SummarizationGeneral ClassificationMulti-Label Classification+3Progressive VAE Training on Highly Sparse and Imbalanced Data
In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution c…
ARCGenerative Adversarial NetworkSentence