Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning
Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher accuracy when there is a limited set of labeled data available. In this paper, we consider the problem of semi-supervised learning with convolutional neural networks. Techniques such as randomized data augmentation, dropout and random max-pooling provide better generalization and stability for classifiers that are trained using gradient descent. Multiple passes of an individual sample through the network might lead to different predictions due to the non-deterministic behavior of these techniques. We propose an unsupervised loss function that takes advantage of the stochastic nature of these methods and minimizes the difference between the predictions of multiple passes of a training sample through the network. We evaluate the proposed method on several benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationSemi-Supervised Image ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Transformation Consistency Regularization – A Semi-Supervised Paradigm for Image-to-Image Translation
Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's pr…
ColorizationDenoisingImage ColorizationImage-to-Image Translation+2Transformation Consistency Regularization- A Semi-Supervised Paradigm for Image-to-Image Translation
Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's pr…
ColorizationDenoisingImage ColorizationImage-to-Image Translation+2WCP: Worst-Case Perturbations for Semi-Supervised Deep Learning
In this paper, we present a novel regularization mechanism for training deep networks by minimizing the Worse-Case Perturbation (WCP). It is based on the idea that a robust model is least likely to be affected by smal…
Deep LearningRevisiting Network Perturbation for Semi-Supervised Semantic Segmentation
In semi-supervised semantic segmentation (SSS), weak-to-strong consistency regularization techniques are widely utilized in recent works, typically combined with input-level and feature-level perturbations. However, the …
Semantic SegmentationSemi-Supervised Semantic SegmentationAdversarial Transformations for Semi-Supervised Learning
We propose a Regularization framework based on Adversarial Transformations (RAT) for semi-supervised learning. RAT is designed to enhance robustness of the output distribution of class prediction for a given data against…
General Classificationimage-classificationImage ClassificationSemi-Supervised Image Classification