Weakly-Supervised Hierarchical Text Classification
Hierarchical text classification, which aims to classify text documents into a given hierarchy, is an important task in many real-world applications. Recently, deep neural models are gaining increasing popularity for text classification due to their expressive power and minimum requirement for feature engineering. However, applying deep neural networks for hierarchical text classification remains challenging, because they heavily rely on a large amount of training data and meanwhile cannot easily determine appropriate levels of documents in the hierarchical setting. In this paper, we propose a weakly-supervised neural method for hierarchical text classification. Our method does not require a large amount of training data but requires only easy-to-provide weak supervision signals such as a few class-related documents or keywords. Our method effectively leverages such weak supervision signals to generate pseudo documents for model pre-training, and then performs self-training on real unlabeled data to iteratively refine the model. During the training process, our model features a hierarchical neural structure, which mimics the given hierarchy and is capable of determining the proper levels for documents with a blocking mechanism. Experiments on three datasets from different domains demonstrate the efficacy of our method compared with a comprehensive set of baselines.
Code (1)
Tasks
BlockingClassificationFeature EngineeringGeneral Classificationtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Efficient Path Prediction for Semi-Supervised and Weakly Supervised Hierarchical Text Classification
Hierarchical text classification has many real-world applications. However, labeling a large number of documents is costly. In practice, we can use semi-supervised learning or weakly supervised learning (e.g., dataless c…
ClassificationGeneral Classificationtext-classificationText Classification+1TELEClass: Taxonomy Enrichment and LLM-Enhanced Hierarchical Text Classification with Minimal Supervision
Hierarchical text classification aims to categorize each document into a set of classes in a label taxonomy. Most earlier works focus on fully or semi-supervised methods that require a large amount of human annotated dat…
Classificationtext-classificationText ClassificationLIME: Weakly-Supervised Text Classification Without Seeds
In weakly-supervised text classification, only label names act as sources of supervision. Predominant approaches to weakly-supervised text classification utilize a two-phase framework, where test samples are first assign…
ClassificationNatural Language Inferencetext-classificationText Classification+1Exploiting Data Hierarchy as a New Modality for Contrastive Learning
This work investigates how hierarchically structured data can help neural networks learn conceptual representations of cathedrals. The underlying WikiScenes dataset provides a spatially organized hierarchical structure o…
Contrastive LearningSelf-Supervised LearningTripletWeakly-supervised LearningDeep Patch Learning for Weakly Supervised Object Classification and Discovery
Patch-level image representation is very important for object classification and detection, since it is robust to spatial transformation, scale variation, and cluttered background. Many existing methods usually require f…
ClassificationGeneral ClassificationMultiple Instance LearningObject+1