Better Self-training for Image Classification through Self-supervision
Self-training is a simple semi-supervised learning approach: Unlabelled examples that attract high-confidence predictions are labelled with their predictions and added to the training set, with this process being repeated multiple times. Recently, self-supervision -- learning without manual supervision by solving an automatically-generated pretext task -- has gained prominence in deep learning. This paper investigates three different ways of incorporating self-supervision into self-training to improve accuracy in image classification: self-supervision as pretraining only, self-supervision performed exclusively in the first iteration of self-training, and self-supervision added to every iteration of self-training. Empirical results on the SVHN, CIFAR-10, and PlantVillage datasets, using both training from scratch, and Imagenet-pretrained weights, show that applying self-supervision only in the first iteration of self-training can greatly improve accuracy, for a modest increase in computation time.
Code (3)
Tasks
Classificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Explorations in Self-Supervised Learning: Dataset Composition Testing for Object Classification
This paper investigates the impact of sampling and pretraining using datasets with different image characteristics on the performance of self-supervised learning (SSL) models for object classification. To do this, we sam…
Self-Supervised LearningSelf-Supervised Representation Learning on Document Images
This work analyses the impact of self-supervised pre-training on document images in the context of document image classification. While previous approaches explore the effect of self-supervision on natural images, we sho…
Classificationdocument-image-classificationDocument Image ClassificationGeneral Classification+3On the robustness of self-supervised representations for multi-view object classification
It is known that representations from self-supervised pre-training can perform on par, and often better, on various downstream tasks than representations from fully-supervised pre-training. This has been shown in a host …
Image RetrievalObjectRetrievalSemantic SegmentationSelf-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes.…
image-classificationImage ClassificationRemote Sensing Image ClassificationRepresentation Learning+1Improving Medical Image Classification in Noisy Labels Using Only Self-supervised Pretraining
Noisy labels hurt deep learning-based supervised image classification performance as the models may overfit the noise and learn corrupted feature extractors. For natural image classification training with noisy labeled d…
Classificationimage-classificationImage ClassificationLearning with noisy labels+2