ReMix: Calibrated Resampling for Class Imbalance in Deep learning
Class imbalance is a problem of significant importance in applied deep learning where trained models are exploited for decision support and automated decisions in critical areas such as health and medicine, transportation, and finance. The challenge of learning deep models from imbalanced training data remains high, and the state-of-the-art solutions are typically data dependent and primarily focused on image data. Real-world imbalanced classification problems, however, are much more diverse thus necessitating a general solution that can be applied to tabular, image and text data. In this paper, we propose ReMix, a training technique that leverages batch resampling, instance mixing and soft-labels to enable the induction of robust deep models for imbalanced learning. Our results show that dense nets and CNNs trained with ReMix generally outperform the alternatives according to the g-mean and are better calibrated according to the balanced Brier score.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep Learningimbalanced classificationSimilar Papers 제목 키워드 기반
Remix: Rebalanced Mixup
Deep image classifiers often perform poorly when training data are heavily class-imbalanced. In this work, we propose a new regularization technique, Remix, that relaxes Mixup's formulation and enables the mixing factors…
Queue-based Resampling for Online Class Imbalance Learning
Online class imbalance learning constitutes a new problem and an emerging research topic that focusses on the challenges of online learning under class imbalance and concept drift. Class imbalance deals with data streams…
Imbalanced classification: a paradigm-based review
A common issue for classification in scientific research and industry is the existence of imbalanced classes. When sample sizes of different classes are imbalanced in training data, naively implementing a classification …
Binary ClassificationClassificationGeneral Classificationimbalanced classificationInfluence of Resampling on Accuracy of Imbalanced Classification
In many real-world binary classification tasks (e.g. detection of certain objects from images), an available dataset is imbalanced, i.e., it has much less representatives of a one class (a minor class), than of another. …
Binary ClassificationClassificationGeneral Classificationimbalanced classificationWhen resampling/reweighting improves feature learning in imbalanced classification?: A toy-model study
A toy model of binary classification is studied with the aim of clarifying the class-wise resampling/reweighting effect on the feature learning performance under the presence of class imbalance. In the analysis, a high-d…
Binary Classificationimbalanced classification