Re-evaluating Extreme Multi-label Text Classification Methods in Tail Label Prediction
Extreme multi-label text classification (XMTC) is the task of tagging each document with the relevant labels in a very large set of predefined category labels. The most challenging part of the problem is due to a highly skewed label distribution where the majority of the categories (namely the tail labels) have very few training instances. Recent benchmark evaluations have focused on micro-averaging metrics, where the performance on tail labels can be easily overshadowed by that on the high-frequency labels (namely the head labels). This paper presents a re-evaluation of state-of-the-art (SOTA) methods based on the binned macro-averaging F1 instead, revealing new insights into the strengths and weaknesses of representative methods, especially in tail label prediction.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi Label Text ClassificationMulti-Label Text Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
On Evaluation and Improvement of Tail Label Performance for Multi-label Text Classification
Extreme multi-label text classification (XMTC) is a task for tagging each document with the most relevant subset of labels from an extremely large label set. The most challenging part for machine learning methods is the …
Multi Label Text ClassificationMulti-Label Text Classificationtext-classificationText ClassificationEvaluating Extreme Hierarchical Multi-label Classification
Several natural language processing (NLP) tasks are defined as a classification problem in its most complex form: Multi-label Hierarchical Extreme classification, in which items may be associated with multiple classes fr…
ClassificationHierarchical Multi-label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONEvaluating Extreme Hierarchical Multi-label Classification
Several natural language processing (NLP) tasks are defined as a classification problem in its most complex form: Multi-label Hierarchical Extreme classification, in which items may be associated with multiple classes fr…
ClassificationHierarchical Multi-label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONAdopting the Multi-answer Questioning Task with an Auxiliary Metric for Extreme Multi-label Text Classification Utilizing the Label Hierarchy
Extreme multi-label text classification utilizes the label hierarchy to partition extreme labels into multiple label groups, turning the task into simple multi-group multi-label classification tasks. Current research enc…
ClassificationExtreme Multi-Label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+5HAXMLNet: Hierarchical Attention Network for Extreme Multi-Label Text Classification
Extreme multi-label text classification (XMTC) addresses the problem of tagging each text with the most relevant labels from an extreme-scale label set. Traditional methods use bag-of-words (BOW) representations without …
ClassificationGeneral ClassificationMulti Label Text ClassificationMulti-Label Text Classification+2