Evaluating Extreme Hierarchical Multi-label Classification
Several natural language processing (NLP) tasks are defined as a classification problem in its most complex form: Multi-label Hierarchical Extreme classification, in which items may be associated with multiple classes from a set of thousands of possible classes organized in a hierarchy and with a highly unbalanced distribution both in terms of class frequency and the number of labels per item. We analyze the state of the art of evaluation metrics based on a set of formal properties and we define an information theoretic based metric inspired by the Information Contrast Model (ICM). Experiments on synthetic data and a case study on real data show the suitability of the ICM for such scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationHierarchical Multi-label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSimilar Papers 제목 키워드 기반
Evaluating Extreme Hierarchical Multi-label Classification
Several natural language processing (NLP) tasks are defined as a classification problem in its most complex form: Multi-label Hierarchical Extreme classification, in which items may be associated with multiple classes fr…
ClassificationHierarchical Multi-label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONHAXMLNet: Hierarchical Attention Network for Extreme Multi-Label Text Classification
Extreme multi-label text classification (XMTC) addresses the problem of tagging each text with the most relevant labels from an extreme-scale label set. Traditional methods use bag-of-words (BOW) representations without …
ClassificationGeneral ClassificationMulti Label Text ClassificationMulti-Label Text Classification+2A no-regret generalization of hierarchical softmax to extreme multi-label classification
Extreme multi-label classification (XMLC) is a problem of tagging an instance with a small subset of relevant labels chosen from an extremely large pool of possible labels. Large label spaces can be efficiently handled b…
Extreme Multi-Label ClassificationGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONInvestigating Active Learning Sampling Strategies for Extreme Multi Label Text Classification
Large scale, multi-label text datasets with high numbers of different classes are expensive to annotate, even more so if they deal with domain specific language. In this work, we aim to build classifiers on these dataset…
Active LearningExtreme Multi-Label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION+4Probabilistic Label Trees for Extreme Multi-label Classification
Extreme multi-label classification (XMLC) is a learning task of tagging instances with a small subset of relevant labels chosen from an extremely large pool of possible labels. Problems of this scale can be efficiently h…
ClassificationExtreme Multi-Label ClassificationGeneral ClassificationMulti-Label Classification+1