Long-tailed Extreme Multi-label Text Classification with Generated Pseudo Label Descriptions
Extreme Multi-label Text Classification (XMTC) has been a tough challenge in machine learning research and applications due to the sheer sizes of the label spaces and the severe data scarce problem associated with the long tail of rare labels in highly skewed distributions. This paper addresses the challenge of tail label prediction by proposing a novel approach, which combines the effectiveness of a trained bag-of-words (BoW) classifier in generating informative label descriptions under severe data scarce conditions, and the power of neural embedding based retrieval models in mapping input documents (as queries) to relevant label descriptions. The proposed approach achieves state-of-the-art performance on XMTC benchmark datasets and significantly outperforms the best methods so far in the tail label prediction. We also provide a theoretical analysis for relating the BoW and neural models w.r.t. performance lower bound.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi Label Text ClassificationMulti-Label Text ClassificationPseudo LabelRetrievaltext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Multi-Label Classification Method Based on Extreme Learning Machines
In this paper, an Extreme Learning Machine (ELM) based technique for Multi-label classification problems is proposed and discussed. In multi-label classification, each of the input data samples belongs to one or more tha…
ClassificationGeneral ClassificationMulti-class ClassificationMulti-Label Classification+1TRCGL-Net: A Long-Tailed Multi-Label Chest X-Ray Classification Framework with Generative Data Augmentation and Label Co-Occurrence Modeling
Chest X-ray multi-label classification is a core task in intelligent medical imaging diagnosis. However, real clinical data often exhibit extreme long-tailed distributions, leading to degraded performance on rare disease…
Multi-Label ClassificationData AugmentationGNN-XML: Graph Neural Networks for Extreme Multi-label Text Classification
Extreme multi-label text classification (XMTC) aims to tag a text instance with the most relevant subset of labels from an extremely large label set. XMTC has attracted much recent attention due to massive label sets yie…
ClusteringGeneral ClassificationGraph ClusteringGraph Neural Network+8Handling Supervision Scarcity in Chest X-ray Classification: Long-Tailed and Zero-Shot Learning
Chest X-Ray (CXR) classification in clinical practice is often limited by imperfect supervision, arising from (i) extreme long-tailed multi-label disease distributions and (ii) missing annotations for rare or previously …
Multi-Label ClassificationMulti-Label LearningZero-Shot LearningBalancing Domain Experts for Long-Tailed Camera-Trap Recognition
Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extreme…
Long-tail LearningOptical Flow Estimation