paper-with-me

Papers

Variational Self-Supervised Contrastive Learning Using Beta Divergence

2023-09-05 · Mehmet Can Yavuz, Berrin Yanikoglu

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of variational methods. The method (VCL) utilizes variational contrastive learning with beta-divergence to learn robustly from unlabelled datasets, including uncurated and noisy datasets. We demonstrate the effectiveness of the proposed method through rigorous experiments including linear evaluation and fine-tuning scenarios with multi-label datasets in the face understanding domain. In almost all tested scenarios, VCL surpasses the performance of state-of-the-art self-supervised methods, achieving a noteworthy increase in accuracy.

📄 PDF Abstract BibTeX arXiv:2312.00824

Code (0)

등록된 구현이 없습니다.

Tasks

Face RecognitionLinear evaluationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

AAVAE: Augmentation-Augmented Variational Autoencoders

2021-09-29 · William Alejandro Falcon, Ananya Harsh Jha, Teddy Koker, Kyunghyun Cho

Recent methods for self-supervised learning can be grouped into two paradigms: contrastive and non-contrastive approaches. Their success can largely be attributed to data augmentation pipelines which generate multiple vi…

Contrastive LearningData Augmentationimage-classificationImage Classification+1

RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence

2022-08-12 · Kyungmin Lee, Jinwoo Shin

Contrastive representation learning seeks to acquire useful representations by estimating the shared information between multiple views of data. Here, the choice of data augmentation is sensitive to the quality of learne…

Contrastive LearningData AugmentationRepresentation Learning

Robust Variational Autoencoder for Tabular Data with Beta Divergence

2020-06-15 · Haleh Akrami, Sergul Aydore, Richard M. Leahy, Anand A. Joshi

We propose a robust variational autoencoder with $\beta$ divergence for tabular data (RTVAE) with mixed categorical and continuous features. Variational autoencoders (VAE) and their variations are popular frameworks for …

Anomaly DetectionData Poisoning

Alpha-Beta Divergence For Variational Inference

2018-05-02 · Jean-Baptiste Regli, Ricardo Silva

This paper introduces a variational approximation framework using direct optimization of what is known as the {\it scale invariant Alpha-Beta divergence} (sAB divergence). This new objective encompasses most variational …

Variational Inference

AASAE: Augmentation-Augmented Stochastic Autoencoders

2021-07-26 · William Falcon, Ananya Harsh Jha, Teddy Koker, Kyunghyun Cho

Recent methods for self-supervised learning can be grouped into two paradigms: contrastive and non-contrastive approaches. Their success can largely be attributed to data augmentation pipelines which generate multiple vi…

Contrastive LearningData Augmentationimage-classificationImage Classification+1