paper-with-me

홈 › Papers

ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learning

2021-10-20 · NeurIPS 2021 12 · Hyuck Lee, Seungjae Shin, Heeyoung Kim

Existing semi-supervised learning (SSL) algorithms typically assume class-balanced datasets, although the class distributions of many real-world datasets are imbalanced. In general, classifiers trained on a class-imbalanced dataset are biased toward the majority classes. This issue becomes more problematic for SSL algorithms because they utilize the biased prediction of unlabeled data for training. However, traditional class-imbalanced learning techniques, which are designed for labeled data, cannot be readily combined with SSL algorithms. We propose a scalable class-imbalanced SSL algorithm that can effectively use unlabeled data, while mitigating class imbalance by introducing an auxiliary balanced classifier (ABC) of a single layer, which is attached to a representation layer of an existing SSL algorithm. The ABC is trained with a class-balanced loss of a minibatch, while using high-quality representations learned from all data points in the minibatch using the backbone SSL algorithm to avoid overfitting and information loss.Moreover, we use consistency regularization, a recent SSL technique for utilizing unlabeled data in a modified way, to train the ABC to be balanced among the classes by selecting unlabeled data with the same probability for each class. The proposed algorithm achieves state-of-the-art performance in various class-imbalanced SSL experiments using four benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2110.10368

Code (1)

leehyuck/abc 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

ABC Class of methods in Bayesian Statistics where the posterior distribution is approximated over a rejection scheme on simulations because the likelihood function is…

Similar Papers 제목 키워드 기반

Imbalanced Semi-supervised Learning with Bias Adaptive Classifier

2022-07-28 · Renzhen Wang, Xixi Jia, Quanziang Wang, Yichen Wu 외

Pseudo-labeling has proven to be a promising semi-supervised learning (SSL) paradigm. Existing pseudo-labeling methods commonly assume that the class distributions of training data are balanced. However, such an assumpti…

Rethinking the Value of Labels for Improving Class-Imbalanced Learning

2020-06-13 · NeurIPS 2020 12 · Yuzhe Yang, Zhi Xu

Real-world data often exhibits long-tailed distributions with heavy class imbalance, posing great challenges for deep recognition models. We identify a persisting dilemma on the value of labels in the context of imbalanc…

Long-tail Learning

Cluster-Guided Semi-Supervised Domain Adaptation for Imbalanced Medical Image Classification

2023-03-02 · Shota Harada, Ryoma Bise, Kengo Araki, Akihiko Yoshizawa 외

Semi-supervised domain adaptation is a technique to build a classifier for a target domain by modifying a classifier in another (source) domain using many unlabeled samples and a small number of labeled samples from the …

ClusteringDomain Adaptationimage-classificationImage Classification+3

CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learning

2021-12-08 · CVPR 2022 1 · Yue Fan, Dengxin Dai, Anna Kukleva, Bernt Schiele

In this paper, we propose a novel co-learning framework (CoSSL) with decoupled representation learning and classifier learning for imbalanced SSL. To handle the data imbalance, we devise Tail-class Feature Enhancement (T…

Representation Learning

CDMAD: Class-Distribution-Mismatch-Aware Debiasing for Class-Imbalanced Semi-Supervised Learning

2024-03-15 · CVPR 2024 1 · Hyuck Lee, Heeyoung Kim

Pseudo-label-based semi-supervised learning (SSL) algorithms trained on a class-imbalanced set face two cascading challenges: 1) Classifiers tend to be biased towards majority classes, and 2) Biased pseudo-labels are use…

Pseudo Label