ViTSGMM: A Robust Semi-Supervised Image Recognition Network Using Sparse Labels
We present ViTSGMM, an image recognition network that leverages semi-supervised learning in a highly efficient manner. Existing works often rely on complex training techniques and architectures, while their generalization ability when dealing with extremely limited labeled data remains to be improved. To address these limitations, we construct a hierarchical mixture density classification decision mechanism by optimizing mutual information between feature representations and target classes, compressing redundant information while retaining crucial discriminative components. Experimental results demonstrate that our method achieves state-of-the-art performance on STL-10 and CIFAR-10/100 datasets when using negligible labeled samples. Notably, this paper also reveals a long-overlooked data leakage issue in the STL-10 dataset for semi-supervised learning tasks and removes duplicates to ensure the reliability of experimental results. Code available at https://github.com/Shu1L0n9/ViTSGMM.
Code (1)
Tasks
Semi-Supervised Image ClassificationSimilar Papers 제목 키워드 기반
Semi-Supervised Sparse Coding
Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by spar…
Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition
Image recognition techniques heavily rely on abundant labeled data, particularly in medical contexts. Addressing the challenges associated with obtaining labeled data has led to the prominence of self-supervised learning…
Self-Supervised LearningSemi-Supervised Sparse Representation Based Classification for Face Recognition with Insufficient Labeled Samples
This paper addresses the problem of face recognition when there is only few, or even only a single, labeled examples of the face that we wish to recognize. Moreover, these examples are typically corrupted by nuisance var…
Face RecognitionGeneral ClassificationSparse Representation-based ClassificationLow-rank representations with incoherent dictionary for face recognition
Face recognition remains a hot topic in computer vision, and it is challenging to tackle the problem that both the training and testing images are corrupted. In this paper, we propose a novel semi-supervised method based…
Face RecognitionSemi-supervised Learning with Sparse Autoencoders in Phone Classification
We propose the application of a semi-supervised learning method to improve the performance of acoustic modelling for automatic speech recognition based on deep neural net- works. As opposed to unsupervised initialisation…
Acoustic ModellingAutomatic Speech RecognitionAutomatic Speech Recognition (ASR)Classification+3