Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works
Deep learning has achieved great success in learning features from massive remote sensing images (RSIs). To better understand the connection between feature learning paradigms (e.g., unsupervised feature learning (USFL), supervised feature learning (SFL), and self-supervised feature learning (SSFL)), this paper analyzes and compares them from the perspective of feature learning signals, and gives a unified feature learning framework. Under this unified framework, we analyze the advantages of SSFL over the other two learning paradigms in RSIs understanding tasks and give a comprehensive review of the existing SSFL work in RS, including the pre-training dataset, self-supervised feature learning signals, and the evaluation methods. We further analyze the effect of SSFL signals and pre-training data on the learned features to provide insights for improving the RSI feature learning. Finally, we briefly discuss some open problems and possible research directions.
Code (1)
Similar Papers 제목 키워드 기반
Self-Supervised In-Domain Representation Learning for Remote Sensing Image Scene Classification
Transferring the ImageNet pre-trained weights to the various remote sensing tasks has produced acceptable results and reduced the need for labeled samples. However, the domain differences between ground imageries and rem…
Land Cover ClassificationRepresentation LearningScene ClassificationSelf-Supervised Learning+1Incomplete Multimodal Learning for Remote Sensing Data Fusion
The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assum…
Semantic SegmentationPattern Integration and Enhancement Vision Transformer for Self-Supervised Learning in Remote Sensing
Recent self-supervised learning (SSL) methods have demonstrated impressive results in learning visual representations from unlabeled remote sensing images. However, most remote sensing images predominantly consist of sce…
Change DetectionLand Cover Classificationobject-detectionObject Detection+2Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes.…
image-classificationImage ClassificationRemote Sensing Image ClassificationRepresentation Learning+1Extending global-local view alignment for self-supervised learning with remote sensing imagery
Since large number of high-quality remote sensing images are readily accessible, exploiting the corpus of images with less manual annotation draws increasing attention. Self-supervised models acquire general feature repr…
Change DetectionContrastive LearningImage ClassificationKnowledge Distillation+5