paper-with-me

홈 › Papers

Cluster-Guided Label Generation in Extreme Multi-Label Classification

2023-02-17 · Taehee Jung, Joo-Kyung Kim, Sungjin Lee, Dongyeop Kang

For extreme multi-label classification (XMC), existing classification-based models poorly perform for tail labels and often ignore the semantic relations among labels, like treating "Wikipedia" and "Wiki" as independent and separate labels. In this paper, we cast XMC as a generation task (XLGen), where we benefit from pre-trained text-to-text models. However, generating labels from the extremely large label space is challenging without any constraints or guidance. We, therefore, propose to guide label generation using label cluster information to hierarchically generate lower-level labels. We also find that frequency-based label ordering and using decoding ensemble methods are critical factors for the improvements in XLGen. XLGen with cluster guidance significantly outperforms the classification and generation baselines on tail labels, and also generally improves the overall performance in four popular XMC benchmarks. In human evaluation, we also find XLGen generates unseen but plausible labels. Our code is now available at https://github.com/alexa/xlgen-eacl-2023.

📄 PDF Abstract BibTeX arXiv:2302.09150

Code (1)

alexa/xlgen-eacl-2023 공식 구현 pytorch

Tasks

ClassificationExtreme Multi-Label ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

Similar Papers 제목 키워드 기반

Application of Deep Learning Methods to SNOMED CT Encoding of Clinical Texts: From Data Collection to Extreme Multi-Label Text-Based Classification

2021-09-01 · RANLP 2021 9 · Anton Hristov, Aleksandar Tahchiev, Hristo Papazov, Nikola Tulechki 외

Concept normalization of clinical texts to standard medical classifications and ontologies is a task with high importance for healthcare and medical research. We attempt to solve this problem through automatic SNOMED CT …

ClassificationData AugmentationDataset Generation

Block-wise Partitioning for Extreme Multi-label Classification

2018-11-04 · Yuefeng Liang, Cho-Jui Hsieh, Thomas C. M. Lee

Extreme multi-label classification aims to learn a classifier that annotates an instance with a relevant subset of labels from an extremely large label set. Many existing solutions embed the label matrix to a low-dimensi…

ClassificationExtreme Multi-Label ClassificationGeneral ClassificationMulti-Label Classification+1

Pretrained Generalized Autoregressive Model with Adaptive Probabilistic Label Cluster for Extreme Multi-label Text Classification

2020-01-01 · ICML 2020 1 · Hui Ye, Zhiyu Chen, Da-Han Wang, Brian Davison

Extreme multi-label text classification (XMTC) is a task for tagging a given text with the most relevant labels from an extremely large label set. We propose a novel deep learning method called APLC-XLNet. Our approach…

Multi Label Text ClassificationMulti-Label Text Classificationtext-classificationText Classification

Pretrained Generalized Autoregressive Model with Adaptive Probabilistic Label Clusters for Extreme Multi-label Text Classification

2020-07-05 · Hui Ye, Zhiyu Chen, Da-Han Wang, Brian D. Davison

Extreme multi-label text classification (XMTC) is a task for tagging a given text with the most relevant labels from an extremely large label set. We propose a novel deep learning method called APLC-XLNet. Our approach f…

Multi-Label Text ClassificationText Classification

Label Disentanglement in Partition-based Extreme Multilabel Classification

2021-06-24 · NeurIPS 2021 12 · Xuanqing Liu, Wei-Cheng Chang, Hsiang-Fu Yu, Cho-Jui Hsieh 외

Partition-based methods are increasingly-used in extreme multi-label classification (XMC) problems due to their scalability to large output spaces (e.g., millions or more). However, existing methods partition the large l…

ClassificationDisentanglementExtreme Multi-Label ClassificationMulti-Label Classification+1