paper-with-me

홈 › Papers

IPCL: Iterative Pseudo-Supervised Contrastive Learning to Improve Self-Supervised Feature Representation

2024-03-18 · IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2024 3 · Sonal Kumar; Anirudh Phukan, Arijit Sur

Self-supervised learning with a contrastive batch approach has become a powerful tool for representation learning in computer vision. The performance of downstream tasks is proportional to the quality of visual features learned while self-supervised pre-training. The existing contrastive batch approaches heavily depend on data augmentation to learn latent information from unlabelled datasets. We argue that introducing the dataset’s intra-class variation in a contrastive batch approach improves visual representation quality further. In this paper, we propose a novel self-supervised learning approach named Iterative Pseudo-supervised Contrastive Learning (IPCL), which utilizes a balanced combination of image augmentations and pseudo-class information to improve the visual representation iteratively. Experimental results illustrate that our proposed method surpasses the baseline self-supervised method with the batch contrastive approach. It improves the visual representation quality over multiple datasets, leading to better performance on the downstream unsupervised image classification task.

📄 PDF Abstract BibTeX

Code (1)

SonalKumar95/IPCL pytorch

Tasks

Contrastive LearningData Augmentationimage-classificationImage ClassificationImage ClusteringRepresentation LearningSelf-Supervised Image ClassificationSelf-Supervised LearningUnsupervised Image Classification

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Multiple Instance Learning via Iterative Self-Paced Supervised Contrastive Learning

2022-10-17 · CVPR 2023 1 · Kangning Liu, Weicheng Zhu, Yiqiu Shen, Sheng Liu 외

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-…

Contrastive Learningimage-classificationImage ClassificationMedical Image Classification+2

CLIP-FLow: Contrastive Learning by semi-supervised Iterative Pseudo labeling for Optical Flow Estimation

2022-10-25 · Zhiqi Zhang, Nitin Bansal, Changjiang Cai, Pan Ji 외

Synthetic datasets are often used to pretrain end-to-end optical flow networks, due to the lack of a large amount of labeled, real-scene data. But major drops in accuracy occur when moving from synthetic to real scenes. …

Contrastive LearningOptical Flow EstimationTransfer Learning

Establishing Strong Baselines for TripClick Health Retrieval

2022-01-02 · Sebastian Hofstätter, Sophia Althammer, Mete Sertkan, Allan Hanbury

We present strong Transformer-based re-ranking and dense retrieval baselines for the recently released TripClick health ad-hoc retrieval collection. We improve the - originally too noisy - training data with a simple neg…

Re-RankingRetrieval

Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery

2024-10-26 · Yimin Deng, Yuxia Wu, Guoshuai Zhao, Li Zhu 외

New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stag…

ClusteringContrastive LearningIntent DiscoveryOpen Intent Discovery+3

Unsupervised Sound Localization via Iterative Contrastive Learning

2021-04-01 · Yan-Bo Lin, Hung-Yu Tseng, Hsin-Ying Lee, Yen-Yu Lin 외

Sound localization aims to find the source of the audio signal in the visual scene. However, it is labor-intensive to annotate the correlations between the signals sampled from the audio and visual modalities, thus makin…

Contrastive Learning