Text Classification with Negative Supervision
Advanced pre-trained models for text representation have achieved state-of-the-art performance on various text classification tasks. However, the discrepancy between the semantic similarity of texts and labelling standards affects classifiers, i.e. leading to lower performance in cases where classifiers should assign different labels to semantically similar texts. To address this problem, we propose a simple multitask learning model that uses negative supervision. Specifically, our model encourages texts with different labels to have distinct representations. Comprehensive experiments show that our model outperforms the state-of-the-art pre-trained model on both single- and multi-label classifications, sentence and document classifications, and classifications in three different languages.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationSemantic SimilaritySemantic Textual SimilaritySentencetext-classificationText ClassificationSimilar Papers 제목 키워드 기반
One-class Text Classification with Multi-modal Deep Support Vector Data Description
This work presents multi-modal deep SVDD (mSVDD) for one-class text classification. By extending the uni-modal SVDD to a multiple modal one, we build mSVDD with multiple hyperspheres, that enable us to build a much bette…
text-classificationText ClassificationDSReg: Using Distant Supervision as a Regularizer
In this paper, we aim at tackling a general issue in NLP tasks where some of the negative examples are highly similar to the positive examples, i.e., hard-negative examples. We propose the distant supervision as a regula…
Multi-Task LearningReading Comprehensiontext-classificationText ClassificationOn a Guided Nonnegative Matrix Factorization
Fully unsupervised topic models have found fantastic success in document clustering and classification. However, these models often suffer from the tendency to learn less-than-meaningful or even redundant topics when the…
ClusteringTopic ModelsHound: Hunting Supervision Signals for Few and Zero Shot Node Classification on Text-attributed Graph
Text-attributed graph (TAG) is an important type of graph structured data with text descriptions for each node. Few- and zero-shot node classification on TAGs have many applications in fields such as academia and social …
NegationNode ClassificationTAGText MatchingSupervision Adaptation Balancing In-distribution Generalization and Out-of-distribution Detection
The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for…
Out-of-Distribution DetectionOut of Distribution (OOD) Detection