Unsupervised Label Refinement Improves Dataless Text Classification
Dataless text classification is capable of classifying documents into previously unseen labels by assigning a score to any document paired with a label description. While promising, it crucially relies on accurate descriptions of the label set for each downstream task. This reliance causes dataless classifiers to be highly sensitive to the choice of label descriptions and hinders the broader application of dataless classification in practice. In this paper, we ask the following question: how can we improve dataless text classification using the inputs of the downstream task dataset? Our primary solution is a clustering based approach. Given a dataless classifier, our approach refines its set of predictions using k-means clustering. We demonstrate the broad applicability of our approach by improving the performance of two widely used classifier architectures, one that encodes text-category pairs with two independent encoders and one with a single joint encoder. Experiments show that our approach consistently improves dataless classification across different datasets and makes the classifier more robust to the choice of label descriptions.
Code (1)
Tasks
ClassificationClusteringGeneral ClassificationText ClassificationZero-Shot Text ClassificationSimilar Papers 제목 키워드 기반
A Pseudo Label based Dataless Naive Bayes Algorithm for Text Classification with Seed Words
Traditional supervised text classifiers require a large number of manually labeled documents, which are often expensive to obtain. Recently, dataless text classification has attracted more attention, since it only requir…
General ClassificationPseudo Labeltext-classificationText ClassificationPractical Dataless Text Classification Through Dense Retrieval
Dataless text classification aims to classify documents using only class descriptions without any training data. Recent research shows that pre-trained textual entailment models can achieve state-of-the-art dataless cla…
ClassificationNatural Language InferenceRetrievaltext-classification+1Weakly Supervised Prototype Topic Model with Discriminative Seed Words: Modifying the Category Prior by Self-exploring Supervised Signals
Dataless text classification, i.e., a new paradigm of weakly supervised learning, refers to the task of learning with unlabeled documents and a few predefined representative words of categories, known as seed words. The …
text-classificationText ClassificationWeakly-supervised LearningExploring Description-Augmented Dataless Intent Classification
In this work, we introduce several schemes to leverage description-augmented embedding similarity for dataless intent classification using current state-of-the-art (SOTA) text embedding models. We report results of our m…
AvgClassificationintent-classificationIntent ClassificationCross-lingual Dataless Classification for Languages with Small Wikipedia Presence
This paper presents an approach to classify documents in any language into an English topical label space, without any text categorization training data. The approach, Cross-Lingual Dataless Document Classification (CLDD…
ClassificationDocument ClassificationGeneral ClassificationMachine Translation+2