paper-with-me

홈 › Papers

Domain Adaptable Self-supervised Representation Learning on Remote Sensing Satellite Imagery

2023-04-19 · Muskaan Chopra, Prakash Chandra Chhipa, Gopal Mengi, Varun Gupta, Marcus Liwicki

This work presents a novel domain adaption paradigm for studying contrastive self-supervised representation learning and knowledge transfer using remote sensing satellite data. Major state-of-the-art remote sensing visual domain efforts primarily focus on fully supervised learning approaches that rely entirely on human annotations. On the other hand, human annotations in remote sensing satellite imagery are always subject to limited quantity due to high costs and domain expertise, making transfer learning a viable alternative. The proposed approach investigates the knowledge transfer of selfsupervised representations across the distinct source and target data distributions in depth in the remote sensing data domain. In this arrangement, self-supervised contrastive learning-based pretraining is performed on the source dataset, and downstream tasks are performed on the target datasets in a round-robin fashion. Experiments are conducted on three publicly available datasets, UC Merced Landuse (UCMD), SIRI-WHU, and MLRSNet, for different downstream classification tasks versus label efficiency. In self-supervised knowledge transfer, the proposed approach achieves state-of-the-art performance with label efficiency labels and outperforms a fully supervised setting. A more in-depth qualitative examination reveals consistent evidence for explainable representation learning. The source code and trained models are published on GitHub.

📄 PDF Abstract BibTeX arXiv:2304.09874

Code (1)

muskaan712/domain-adaptable-self-supervised-representation-learning-on-remote-sensing-satellite-imagery 공식 구현 pytorch

Tasks

Contrastive LearningDomain AdaptationRepresentation LearningTransfer Learning

Similar Papers 제목 키워드 기반

Self-Supervised Learning of Remote Sensing Scene Representations Using Contrastive Multiview Coding

2021-04-14 · Vladan Stojnić, Vladimir Risojević

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes.…

image-classificationImage ClassificationRemote Sensing Image ClassificationRepresentation Learning+1

Supervised and Contrastive Self-Supervised In-Domain Representation Learning for Dense Prediction Problems in Remote Sensing

2023-01-29 · Ali Ghanbarzade, Dr. Hossein Soleimani

In recent years Convolutional neural networks (CNN) have made significant progress in computer vision. These advancements have been applied to other areas, such as remote sensing and have shown satisfactory results. Howe…

object-detectionObject DetectionRepresentation LearningSelf-Supervised Learning+2

Self-Supervised In-Domain Representation Learning for Remote Sensing Image Scene Classification

2023-02-03 · Ali Ghanbarzade, Hossein Soleimani

Transferring the ImageNet pre-trained weights to the various remote sensing tasks has produced acceptable results and reduced the need for labeled samples. However, the domain differences between ground imageries and rem…

Land Cover ClassificationRepresentation LearningScene ClassificationSelf-Supervised Learning+1

Do we still need ImageNet pre-training in remote sensing scene classification?

2021-11-05 · Vladimir Risojević, Vladan Stojnić

Due to the scarcity of labeled data, using supervised models pre-trained on ImageNet is a de facto standard in remote sensing scene classification. Recently, the availability of larger high resolution remote sensing (HRR…

ClassificationMulti-Label ClassificationScene ClassificationSelf-Supervised Learning

Self-Supervision, Remote Sensing and Abstraction: Representation Learning Across 3 Million Locations

2022-03-08 · Sachith Seneviratne, Kerry A. Nice, Jasper S. Wijnands, Mark Stevenson 외

Self-supervision based deep learning classification approaches have received considerable attention in academic literature. However, the performance of such methods on remote sensing imagery domains remains under-explore…

Representation Learning