SAT: Improving Semi-Supervised Text Classification with Simple Instance-Adaptive Self-Training
Self-training methods have been explored in recent years and have exhibited great performance in improving semi-supervised learning. This work presents a Simple instance-Adaptive self-Training method (SAT) for semi-supervised text classification. SAT first generates two augmented views for each unlabeled data and then trains a meta-learner to automatically identify the relative strength of augmentations based on the similarity between the original view and the augmented views. The weakly-augmented view is fed to the model to produce a pseudo-label and the strongly-augmented view is used to train the model to predict the same pseudo-label. We conducted extensive experiments and analyses on three text classification datasets and found that with varying sizes of labeled training data, SAT consistently shows competitive performance compared to existing semi-supervised learning methods. Our code can be found at \url{https://github.com/declare-lab/SAT.git}.
Code (1)
Tasks
Pseudo LabelSemi-Supervised Text ClassificationText ClassificationSimilar Papers 제목 키워드 기반
Semi-Supervised Histology Classification using Deep Multiple Instance Learning and Contrastive Predictive Coding
Convolutional neural networks can be trained to perform histology slide classification using weak annotations with multiple instance learning (MIL). However, given the paucity of labeled histology data, direct applicatio…
Binary ClassificationClassificationClassification Of Breast Cancer Histology ImagesGeneral Classification+2PAWS-VMK: A Unified Approach To Semi-Supervised Learning And Out-of-Distribution Detection
This paper describes PAWS-VMK, a prototypical deep learning approach that obtains state-of-the-art results for image classification tasks in both a semi-supervised learning (SSL) and out-of-distribution (OOD) detection c…
Benchmarkingimage-classificationImage ClassificationOut-of-Distribution Detection+2Deep Learning with Sets and Point Clouds
We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. …
ClusteringDeep LearningGeneral ClassificationOutlier DetectionSemi-supervised Classification for Natural Language Processing
Semi-supervised classification is an interesting idea where classification models are learned from both labeled and unlabeled data. It has several advantages over supervised classification in natural language processing …
ClassificationGeneral Classificationtext-classificationText ClassificationRevisiting Semi-Supervised Learning with Graph Embeddings
We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the g…
Document ClassificationEntity Extraction using GANGeneral ClassificationNode Classification+1