Multi-network Contrastive Learning Based on Global and Local Representations
The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the combination of global and local feature information. This paper proposes a multi-network contrastive learning framework based on global and local representations. We introduce global and local feature information for self-supervised contrastive learning through multiple networks. The model learns feature information at different scales of an image by contrasting the embedding pairs generated by multiple networks. The framework also expands the number of samples used for contrast and improves the training efficiency of the model. Linear evaluation results on three benchmark datasets show that our method outperforms several existing classical self-supervised learning methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningLinear evaluationSelf-Supervised LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multi-level Graph Subspace Contrastive Learning for Hyperspectral Image Clustering
Hyperspectral image (HSI) clustering is a challenging task due to its high complexity. Despite subspace clustering shows impressive performance for HSI, traditional methods tend to ignore the global-local interaction in …
ClusteringContrastive Learninghyperspectral image clusteringImage ClusteringContrastive Learning of Global-Local Video Representations
Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{gl…
ClassificationContrastive LearningDeepFake DetectionFace Swapping+4Contrastive Learning of Global and Local Video Representations
Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., global rep…
ClassificationContrastive LearningDeepFake DetectionFace Swapping+2GL-CLeF: A Global–Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding
Due to high data demands of current methods, attention to zero-shot cross-lingual spoken language understanding (SLU) has grown, as such approaches greatly reduce human annotation effort. However, existing models solely …
Contrastive LearningCross-Lingual TransferSentenceSpoken Language UnderstandingGL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding
Due to high data demands of current methods, attention to zero-shot cross-lingual spoken language understanding (SLU) has grown, as such approaches greatly reduce human annotation effort. However, existing models solely …
Contrastive LearningCross-Lingual TransferSentenceSpoken Language Understanding