Self-Supervised Image Representation Learning: Transcending Masking with Paired Image Overlay
Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation. This paper proposes a novel image augmentation technique, overlaying images, which has not been widely applied in self-supervised learning. This method is designed to provide better guidance for the model to understand underlying information, resulting in more useful representations. The proposed method is evaluated using contrastive learning, a widely used self-supervised learning method that has shown solid performance in downstream tasks. The results demonstrate the effectiveness of the proposed augmentation technique in improving the performance of self-supervised models.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningImage AugmentationRepresentation LearningSelf-Supervised LearningSimilar Papers 제목 키워드 기반
MPS-AMS: Masked Patches Selection and Adaptive Masking Strategy Based Self-Supervised Medical Image Segmentation
Existing self-supervised learning methods based on contrastive learning and masked image modeling have demonstrated impressive performances. However, current masked image modeling methods are mainly utilized in natural i…
Contrastive LearningImage SegmentationMedical Image SegmentationSegmentation+2Adversarial Masking for Self-Supervised Learning
We propose ADIOS, a masked image model (MIM) framework for self-supervised learning, which simultaneously learns a masking function and an image encoder using an adversarial objective. The image encoder is trained to min…
Representation LearningSelf-Supervised LearningTransfer LearningMask What Matters: Controllable Text-Guided Masking for Self-Supervised Medical Image Analysis
The scarcity of annotated data in specialized domains such as medical imaging presents significant challenges to training robust vision models. While self-supervised masked image modeling (MIM) offers a promising solutio…
Self-Supervised LearningRepresentation LearningImproving self-supervised representation learning via sequential adversarial masking
Recent methods in self-supervised learning have demonstrated that masking-based pretext tasks extend beyond NLP, serving as useful pretraining objectives in computer vision. However, existing approaches apply random or a…
Representation LearningSelf-Supervised LearningJoint Low-level and High-level Textual Representation Learning with Multiple Masking Strategies
Most existing text recognition methods are trained on large-scale synthetic datasets due to the scarcity of labeled real-world datasets. Synthetic images, however, cannot faithfully reproduce real-world scenarios, such a…
Contrastive LearningImage Super-ResolutionRepresentation LearningSelf-Supervised Learning+1