Adversarial Training Methods for Semi-Supervised Text Classification
Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making small perturbations to numerous entries of the input vector, which is inappropriate for sparse high-dimensional inputs such as one-hot word representations. We extend adversarial and virtual adversarial training to the text domain by applying perturbations to the word embeddings in a recurrent neural network rather than to the original input itself. The proposed method achieves state of the art results on multiple benchmark semi-supervised and purely supervised tasks. We provide visualizations and analysis showing that the learned word embeddings have improved in quality and that while training, the model is less prone to overfitting. Code is available at https://github.com/tensorflow/models/tree/master/research/adversarial_text.
Code (4)
Tasks
ClassificationGeneral ClassificationSemi-Supervised Text ClassificationSentiment AnalysisText ClassificationWord EmbeddingsSimilar Papers 제목 키워드 기반
Semi-Supervised Learning with Context-Conditional Generative Adversarial Networks
We introduce a simple semi-supervised learning approach for images based on in-painting using an adversarial loss. Images with random patches removed are presented to a generator whose task is to fill in the hole, based …
Image ClassificationSemi-Supervised Image ClassificationPCA: Semi-supervised Segmentation with Patch Confidence Adversarial Training
Deep learning based semi-supervised learning (SSL) methods have achieved strong performance in medical image segmentation, which can alleviate doctors' expensive annotation by utilizing a large amount of unlabeled data. …
Brain Tumor SegmentationImage SegmentationMedical Image SegmentationSegmentation+2Adversarial Learning for Supervised and Semi-supervised Relation Extraction in Biomedical Literature
Adversarial training is a technique of improving model performance by involving adversarial examples in the training process. In this paper, we investigate adversarial training with multiple adversarial examples to benef…
BenchmarkingRelationRelation ExtractionSemi-Supervised Learning for Optical Flow with Generative Adversarial Networks
Convolutional neural networks (CNNs) have recently been applied to the optical flow estimation problem. As training the CNNs requires sufficiently large ground truth training data, existing approaches resort to synthetic…
Generative Adversarial NetworkOptical Flow EstimationComparing effectiveness of regularization methods on text classification: Simple and complex model in data shortage situation
Text classification is the task of assigning a document to a predefined class. However, it is expensive to acquire enough labeled documents or to label them. In this paper, we study the regularization methods' effects on…
text-classificationText Classification