Training general representations for remote sensing using in-domain knowledge
Automatically finding good and general remote sensing representations allows to perform transfer learning on a wide range of applications - improving the accuracy and reducing the required number of training samples. This paper investigates development of generic remote sensing representations, and explores which characteristics are important for a dataset to be a good source for representation learning. For this analysis, five diverse remote sensing datasets are selected and used for both, disjoint upstream representation learning and downstream model training and evaluation. A common evaluation protocol is used to establish baselines for these datasets that achieve state-of-the-art performance. As the results indicate, especially with a low number of available training samples a significant performance enhancement can be observed when including additionally in-domain data in comparison to training models from scratch or fine-tuning only on ImageNet (up to 11% and 40%, respectively, at 100 training samples). All datasets and pretrained representation models are published online.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningTransfer LearningSimilar Papers 제목 키워드 기반
Generic Knowledge Boosted Pre-training For Remote Sensing Images
Deep learning models are essential for scene classification, change detection, land cover segmentation, and other remote sensing image understanding tasks. Most backbones of existing remote sensing deep learning models a…
Change DetectionDeep LearningGeneral Knowledgeobject-detection+3Supervised and Contrastive Self-Supervised In-Domain Representation Learning for Dense Prediction Problems in Remote Sensing
In recent years Convolutional neural networks (CNN) have made significant progress in computer vision. These advancements have been applied to other areas, such as remote sensing and have shown satisfactory results. Howe…
object-detectionObject DetectionRepresentation LearningSelf-Supervised Learning+2Self-Supervised In-Domain Representation Learning for Remote Sensing Image Scene Classification
Transferring the ImageNet pre-trained weights to the various remote sensing tasks has produced acceptable results and reduced the need for labeled samples. However, the domain differences between ground imageries and rem…
Land Cover ClassificationRepresentation LearningScene ClassificationSelf-Supervised Learning+1Rethinking Electro-Optical Vision Foundation Models for Remote Sensing Retrieval: A Controlled Comparison with Generalist VFM
Vision foundation models have attracted significant attention for their ability to leverage large-scale unlabeled visual data. This advantage is particularly important in remote sensing, where data acquisition is costly …
Image RetrievalSeasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data
Remote sensing and automatic earth monitoring are key to solve global-scale challenges such as disaster prevention, land use monitoring, or tackling climate change. Although there exist vast amounts of remote sensing dat…
Change DetectionSelf-Supervised LearningTransfer LearningUnsupervised Pre-training