Variational Self-Supervised Contrastive Learning Using Beta Divergence
Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of variational methods. The method (VCL) utilizes variational contrastive learning with beta-divergence to learn robustly from unlabelled datasets, including uncurated and noisy datasets. We demonstrate the effectiveness of the proposed method through rigorous experiments including linear evaluation and fine-tuning scenarios with multi-label datasets in the face understanding domain. In almost all tested scenarios, VCL surpasses the performance of state-of-the-art self-supervised methods, achieving a noteworthy increase in accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
Face RecognitionLinear evaluationSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
AAVAE: Augmentation-Augmented Variational Autoencoders
Recent methods for self-supervised learning can be grouped into two paradigms: contrastive and non-contrastive approaches. Their success can largely be attributed to data augmentation pipelines which generate multiple vi…
Contrastive LearningData Augmentationimage-classificationImage Classification+1RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence
Contrastive representation learning seeks to acquire useful representations by estimating the shared information between multiple views of data. Here, the choice of data augmentation is sensitive to the quality of learne…
Contrastive LearningData AugmentationRepresentation LearningRobust Variational Autoencoder for Tabular Data with Beta Divergence
We propose a robust variational autoencoder with $\beta$ divergence for tabular data (RTVAE) with mixed categorical and continuous features. Variational autoencoders (VAE) and their variations are popular frameworks for …
Anomaly DetectionData PoisoningAlpha-Beta Divergence For Variational Inference
This paper introduces a variational approximation framework using direct optimization of what is known as the {\it scale invariant Alpha-Beta divergence} (sAB divergence). This new objective encompasses most variational …
Variational InferenceAASAE: Augmentation-Augmented Stochastic Autoencoders
Recent methods for self-supervised learning can be grouped into two paradigms: contrastive and non-contrastive approaches. Their success can largely be attributed to data augmentation pipelines which generate multiple vi…
Contrastive LearningData Augmentationimage-classificationImage Classification+1