Improving Imbalanced Text Classification with Dynamic Curriculum Learning
Recent advances in pre-trained language models have improved the performance for text classification tasks. However, little attention is paid to the priority scheduling strategy on the samples during training. Humans acquire knowledge gradually from easy to complex concepts, and the difficulty of the same material can also vary significantly in different learning stages. Inspired by this insights, we proposed a novel self-paced dynamic curriculum learning (SPDCL) method for imbalanced text classification, which evaluates the sample difficulty by both linguistic character and model capacity. Meanwhile, rather than using static curriculum learning as in the existing research, our SPDCL can reorder and resample training data by difficulty criterion with an adaptive from easy to hard pace. The extensive experiments on several classification tasks show the effectiveness of SPDCL strategy, especially for the imbalanced dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationSchedulingtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Dynamic Curriculum Learning for Imbalanced Data Classification
Human attribute analysis is a challenging task in the field of computer vision, since the data is largely imbalance-distributed. Common techniques such as re-sampling and cost-sensitive learning require prior-knowledge t…
AttributeClassificationGeneral ClassificationMetric LearningGraph Neural Network with Curriculum Learning for Imbalanced Node Classification
Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for …
ClassificationGraph ClassificationGraph Neural Networkimbalanced classification+2Enhancing Imbalanced Node Classification via Curriculum-Guided Feature Learning and Three-Stage Attention Network
Imbalanced node classification in graph neural networks (GNNs) happens when some labels are much more common than others, which causes the model to learn unfairly and perform badly on the less common classes. To solve th…
Node ClassificationACPL: Anti-curriculum Pseudo-labelling for Semi-supervised Medical Image Classification
Effective semi-supervised learning (SSL) in medical image analysis (MIA) must address two challenges: 1) work effectively on both multi-class (e.g., lesion classification) and multi-label (e.g., multiple-disease diagnosi…
image-classificationImage ClassificationMedical Image AnalysisMedical Image Classification+3DynCIM: Dynamic Curriculum for Imbalanced Multimodal Learning
Multimodal learning integrates complementary information from diverse modalities to enhance the decision-making process. However, the potential of multimodal collaboration remains under-exploited due to disparities in da…
BenchmarkingDecision Making