Self-supervised Learning in Remote Sensing: A Review
In deep learning research, self-supervised learning (SSL) has received great attention triggering interest within both the computer vision and remote sensing communities. While there has been a big success in computer vision, most of the potential of SSL in the domain of earth observation remains locked. In this paper, we provide an introduction to, and a review of the concepts and latest developments in SSL for computer vision in the context of remote sensing. Further, we provide a preliminary benchmark of modern SSL algorithms on popular remote sensing datasets, verifying the potential of SSL in remote sensing and providing an extended study on data augmentations. Finally, we identify a list of promising directions of future research in SSL for earth observation (SSL4EO) to pave the way for fruitful interaction of both domains.
Code (3)
Tasks
Earth ObservationImage ClassificationMulti-Label Image ClassificationSelf-Supervised LearningSimilar Papers 제목 키워드 기반
Joint multi-modal Self-Supervised pre-training in Remote Sensing: Application to Methane Source Classification
With the current ubiquity of deep learning methods to solve computer vision and remote sensing specific tasks, the need for labelled data is growing constantly. However, in many cases, the annotation process can be long …
Earth ObservationMIMRS: A Survey on Masked Image Modeling in Remote Sensing
Masked Image Modeling (MIM) is a self-supervised learning technique that involves masking portions of an image, such as pixels, patches, or latent representations, and training models to predict the missing information u…
Cloud RemovalSelf-Supervised LearningSuper-ResolutionSelf-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding
In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes.…
image-classificationImage ClassificationRemote Sensing Image ClassificationRepresentation Learning+1From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language mode…
Change DetectionContrastive LearningDisaster ResponseDomain Adaptation+7Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works
Deep learning has achieved great success in learning features from massive remote sensing images (RSIs). To better understand the connection between feature learning paradigms (e.g., unsupervised feature learning (USFL),…