Hierarchical Transfer Learning for Multi-label Text Classification
Multi-Label Hierarchical Text Classification (MLHTC) is the task of categorizing documents into one or more topics organized in an hierarchical taxonomy. MLHTC can be formulated by combining multiple binary classification problems with an independent classifier for each category. We propose a novel transfer learning based strategy, HTrans, where binary classifiers at lower levels in the hierarchy are initialized using parameters of the parent classifier and fine-tuned on the child category classification task. In HTrans, we use a Gated Recurrent Unit (GRU)-based deep learning architecture coupled with attention. Compared to binary classifiers trained from scratch, our HTrans approach results in significant improvements of 1{\%} on micro-F1 and 3{\%} on macro-F1 on the RCV1 dataset. Our experiments also show that binary classifiers trained from scratch are significantly better than single multi-label models.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationClassificationGeneral ClassificationMulti Label Text ClassificationMulti-Label Text Classificationtext-classificationText ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
Recent Advances in Hierarchical Multi-label Text Classification: A Survey
Hierarchical multi-label text classification aims to classify the input text into multiple labels, among which the labels are structured and hierarchical. It is a vital task in many real world applications, e.g. scientif…
ClassificationMulti Label Text ClassificationMulti-Label Text ClassificationSurvey+2Hierarchical Text Classification (HTC) vs. eXtreme Multilabel Classification (XML): Two Sides of the Same Medal
Assigning a subset of labels from a fixed pool of labels to a given input text is a text classification problem with many real-world applications, such as in recommender systems. Two separate research streams address thi…
ClassificationMulti Label Text ClassificationMulti-Label Text ClassificationRecommendation Systems+2Academic Resource Text Level Multi-label Classification based on Attention
Hierarchical multi-label academic text classification (HMTC) is to assign academic texts into a hierarchically structured labeling system. We propose an attention-based hierarchical multi-label classification algorithm o…
ClassificationDocument EmbeddingHierarchical Multi-label ClassificationMulti-Label Classification+3Dual-View Alignment Learning with Hierarchical-Prompt for Class-Imbalance Multi-Label Classification
Real-world datasets often exhibit class imbalance across multiple categories, manifesting as long-tailed distributions and few-shot scenarios. This is especially challenging in Class-Imbalanced Multi-Label Image Classifi…
Multi-Label Image ClassificationFew-Shot Image ClassificationMulti-Label ClassificationObject RecognitionDomain-Hierarchy Adaptation via Chain of Iterative Reasoning for Few-shot Hierarchical Text Classification
Recently, various pre-trained language models (PLMs) have been proposed to prove their impressive performances on a wide range of few-shot tasks. However, limited by the unstructured prior knowledge in PLMs, it is diffic…
few-shot-htcFew-shot HTCGraph Neural NetworkLanguage Modeling+6