paper-with-me

Papers

Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning

2016-06-14 · NeurIPS 2016 12 · Mehdi Sajjadi, Mehran Javanmardi, Tolga Tasdizen

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher accuracy when there is a limited set of labeled data available. In this paper, we consider the problem of semi-supervised learning with convolutional neural networks. Techniques such as randomized data augmentation, dropout and random max-pooling provide better generalization and stability for classifiers that are trained using gradient descent. Multiple passes of an individual sample through the network might lead to different predictions due to the non-deterministic behavior of these techniques. We propose an unsupervised loss function that takes advantage of the stochastic nature of these methods and minimizes the difference between the predictions of multiple passes of a training sample through the network. We evaluate the proposed method on several benchmark datasets.

📄 PDF Abstract BibTeX arXiv:1606.04586

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationSemi-Supervised Image Classification

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Transformation Consistency Regularization – A Semi-Supervised Paradigm for Image-to-Image Translation

2020-08-01 · ECCV 2020 8 · Aamir Mustafa, Rafal K. Mantiuk

Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's pr…

ColorizationDenoisingImage ColorizationImage-to-Image Translation+2

Transformation Consistency Regularization- A Semi-Supervised Paradigm for Image-to-Image Translation

2020-07-15 · Aamir Mustafa, Rafal K. Mantiuk

Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's pr…

ColorizationDenoisingImage ColorizationImage-to-Image Translation+2

WCP: Worst-Case Perturbations for Semi-Supervised Deep Learning

2020-06-01 · CVPR 2020 6 · Liheng Zhang, Guo-Jun Qi

In this paper, we present a novel regularization mechanism for training deep networks by minimizing the Worse-Case Perturbation (WCP). It is based on the idea that a robust model is least likely to be affected by smal…

Deep Learning

Revisiting Network Perturbation for Semi-Supervised Semantic Segmentation

2024-11-08 · Sien Li, Tao Wang, Ruizhe Hu, Wenxi Liu

In semi-supervised semantic segmentation (SSS), weak-to-strong consistency regularization techniques are widely utilized in recent works, typically combined with input-level and feature-level perturbations. However, the …

Semantic SegmentationSemi-Supervised Semantic Segmentation

Adversarial Transformations for Semi-Supervised Learning

2019-11-13 · Teppei Suzuki, Ikuro Sato

We propose a Regularization framework based on Adversarial Transformations (RAT) for semi-supervised learning. RAT is designed to enhance robustness of the output distribution of class prediction for a given data against…

General Classificationimage-classificationImage ClassificationSemi-Supervised Image Classification