Multi-Label Self-Supervised Learning with Scene Images
Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that instead of hinging on these strenuous operations, quality image representations can be learned by treating scene/multi-label image SSL simply as a multi-label classification problem, which greatly simplifies the learning framework. Specifically, multiple binary pseudo-labels are assigned for each input image by comparing its embeddings with those in two dictionaries, and the network is optimized using the binary cross entropy loss. The proposed method is named Multi-Label Self-supervised learning (MLS). Visualizations qualitatively show that clearly the pseudo-labels by MLS can automatically find semantically similar pseudo-positive pairs across different images to facilitate contrastive learning. MLS learns high quality representations on MS-COCO and achieves state-of-the-art results on classification, detection and segmentation benchmarks. At the same time, MLS is much simpler than existing methods, making it easier to deploy and for further exploration.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONObject DiscoverySelf-Supervised LearningSimilar Papers 제목 키워드 기반
Unsupervised Object-Level Representation Learning from Scene Images
Contrastive self-supervised learning has largely narrowed the gap to supervised pre-training on ImageNet. However, its success highly relies on the object-centric priors of ImageNet, i.e., different augmented views of th…
ObjectRepresentation LearningSelf-Supervised LearningSemantic correspondenceSelf-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes.…
image-classificationImage ClassificationRemote Sensing Image ClassificationRepresentation Learning+1Self-Supervised Multisensor Change Detection
Most change detection methods assume that pre-change and post-change images are acquired by the same sensor. However, in many real-life scenarios, e.g., natural disaster, it is more practical to use the latest available …
BIG-bench Machine LearningChange DetectionContrastive LearningDeep Clustering+1Saliency Guided Contrastive Learning on Scene Images
Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning…
Contrastive LearningLinear evaluationRepresentation LearningSelf-Supervised LearningRemote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples
With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. Wh…
ClassificationGeneral ClassificationScene ClassificationSelf-Supervised Learning