Heterogeneous Contrastive Learning: Encoding Spatial Information for Compact Visual Representations
Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents heterogeneous contrastive learning (HCL), an effective approach that adds spatial information to the encoding stage to alleviate the learning inconsistency between the contrastive objective and strong data augmentation operations. We demonstrate the effectiveness of HCL by showing that (i) it achieves higher accuracy in instance discrimination and (ii) it surpasses existing pre-training methods in a series of downstream tasks while shrinking the pre-training costs by half. More importantly, we show that our approach achieves higher efficiency in visual representations, and thus delivers a key message to inspire the future research of self-supervised visual representation learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningData AugmentationRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Heterogeneous Contrastive Learning for Foundation Models and Beyond
In the era of big data and Artificial Intelligence, an emerging paradigm is to utilize contrastive self-supervised learning to model large-scale heterogeneous data. Many existing foundation models benefit from the genera…
Contrastive LearningSelf-Supervised LearningSurveyFew-Shot Video Recognition via Hierarchical Metric Learning
Few-shot action recognition (FSAR) aims to recognize unseen action categories with only a small number of annotated video samples. Recent works typically apply single-prototype supervision at the network output and fail …
Action RecognitionMetric LearningKnowledge-aware contrastive heterogeneous molecular graph learning
Molecular representation learning is pivotal in predicting molecular properties and advancing drug design. Traditional methodologies, which predominantly rely on homogeneous graph encoding, are limited by their inability…
BenchmarkingContrastive LearningDrug DesignGraph Learning+5GCL-GCN: Graphormer and Contrastive Learning Enhanced Attributed Graph Clustering Network
Attributed graph clustering holds significant importance in modern data analysis. However, due to the complexity of graph data and the heterogeneity of node attributes, leveraging graph information for clustering remains…
Contrastive LearningGraph ClusteringHeterogeneous Graph Contrastive Learning with Spectral Augmentation
Heterogeneous graphs can well describe the complex entity relationships in the real world. For example, online shopping networks contain multiple physical types of consumers and products, as well as multiple relationship…
Contrastive LearningData AugmentationGraph Representation LearningRepresentation Learning