paper-with-me

홈 › Papers

Multi-network Contrastive Learning Based on Global and Local Representations

2023-06-28 · Weiquan Li, Xianzhong Long, Yun Li

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the combination of global and local feature information. This paper proposes a multi-network contrastive learning framework based on global and local representations. We introduce global and local feature information for self-supervised contrastive learning through multiple networks. The model learns feature information at different scales of an image by contrasting the embedding pairs generated by multiple networks. The framework also expands the number of samples used for contrast and improves the training efficiency of the model. Linear evaluation results on three benchmark datasets show that our method outperforms several existing classical self-supervised learning methods.

📄 PDF Abstract BibTeX arXiv:2306.15930

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningLinear evaluationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Multi-level Graph Subspace Contrastive Learning for Hyperspectral Image Clustering

2024-04-08 · Jingxin Wang, Renxiang Guan, Kainan Gao, Zihao Li 외

Hyperspectral image (HSI) clustering is a challenging task due to its high complexity. Despite subspace clustering shows impressive performance for HSI, traditional methods tend to ignore the global-local interaction in …

ClusteringContrastive Learninghyperspectral image clusteringImage Clustering

Contrastive Learning of Global-Local Video Representations

2021-04-07 · Shuang Ma, Zhaoyang Zeng, Daniel McDuff, Yale Song

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{gl…

ClassificationContrastive LearningDeepFake DetectionFace Swapping+4

Contrastive Learning of Global and Local Video Representations

2021-12-01 · NeurIPS 2021 12 · Shuang Ma, Zhaoyang Zeng, Daniel McDuff, Yale Song

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., global rep…

ClassificationContrastive LearningDeepFake DetectionFace Swapping+2

GL-CLeF: A Global–Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding

2022-05-01 · ACL 2022 5 · Libo Qin, Qiguang Chen, Tianbao Xie, Qixin Li 외

Due to high data demands of current methods, attention to zero-shot cross-lingual spoken language understanding (SLU) has grown, as such approaches greatly reduce human annotation effort. However, existing models solely …

Contrastive LearningCross-Lingual TransferSentenceSpoken Language Understanding

GL-CLeF: A Global-Local Contrastive Learning Framework for Cross-lingual Spoken Language Understanding

2022-04-18 · Libo Qin, Qiguang Chen, Tianbao Xie, Qixin Li 외

Due to high data demands of current methods, attention to zero-shot cross-lingual spoken language understanding (SLU) has grown, as such approaches greatly reduce human annotation effort. However, existing models solely …

Contrastive LearningCross-Lingual TransferSentenceSpoken Language Understanding