GeoMultiTaskNet: remote sensing unsupervised domain adaptation using geographical coordinates

2023-04-16 · Valerio Marsocci, Nicolas Gonthier, Anatol Garioud, Simone Scardapane, Clément Mallet

Land cover maps are a pivotal element in a wide range of Earth Observation (EO) applications. However, annotating large datasets to develop supervised systems for remote sensing (RS) semantic segmentation is costly and time-consuming. Unsupervised Domain Adaption (UDA) could tackle these issues by adapting a model trained on a source domain, where labels are available, to a target domain, without annotations. UDA, while gaining importance in computer vision, is still under-investigated in RS. Thus, we propose a new lightweight model, GeoMultiTaskNet, based on two contributions: a GeoMultiTask module (GeoMT), which utilizes geographical coordinates to align the source and target domains, and a Dynamic Class Sampling (DCS) strategy, to adapt the semantic segmentation loss to the frequency of classes. This approach is the first to use geographical metadata for UDA in semantic segmentation. It reaches state-of-the-art performances (47,22% mIoU), reducing at the same time the number of parameters (33M), on a subset of the FLAIR dataset, a recently proposed dataset properly shaped for RS UDA, used for the first time ever for research scopes here.

📄 PDF Abstract BibTeX arXiv:2304.07750

Code (1)

VMarsocci/geomultitasknet 공식 구현 pytorch

Tasks

Domain AdaptationEarth ObservationSegmentation Semantic Segmentation Unsupervised Domain Adaptation

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

DDF: A Novel Dual-Domain Image Fusion Strategy for Remote Sensing Image Semantic Segmentation with Unsupervised Domain Adaptation

2024-03-05 · Lingyan Ran, Lushuang Wang, Tao Zhuo, Yinghui Xing

Semantic segmentation of remote sensing images is a challenging and hot issue due to the large amount of unlabeled data. Unsupervised domain adaptation (UDA) has proven to be advantageous in incorporating unclassified in…

Domain Adaptation Pseudo Label Semantic Segmentation Unsupervised Domain Adaptation

Brain-Inspired Online Adaptation for Remote Sensing with Spiking Neural Network

2024-09-03 · Dexin Duan, Peilin Liu, Fei Wen

On-device computing, or edge computing, is becoming increasingly important for remote sensing, particularly in applications like deep network-based perception on on-orbit satellites and unmanned aerial vehicles (UAVs). I…

Domain Adaptation Domain Generalization Edge-computing

Universal Domain Adaptation for Remote Sensing Image Scene Classification

2023-01-26 · Qingsong Xu, Yilei Shi, Xin Yuan, Xiao Xiang Zhu

The domain adaptation (DA) approaches available to date are usually not well suited for practical DA scenarios of remote sensing image classification, since these methods (such as unsupervised DA) rely on rich prior know…

Classification Domain Adaptation image-classification Image Classification+3

Joint-Optimized Unsupervised Adversarial Domain Adaptation in Remote Sensing Segmentation with Prompted Foundation Model

2024-11-08 · Shuchang Lyu, Qi Zhao, Guangliang Cheng, Yiwei He 외

Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation (UDA-RSSeg) addresses the challenge of adapting a model trained on source domain data to target domain samples, thereby minimizing the need for anno…

Decoder Domain Adaptation Semantic Segmentation Unsupervised Domain Adaptation

FlowEO: Generative Unsupervised Domain Adaptation for Earth Observation

2025-12-01 · Georges Le Bellier, Nicolas Audebert arxiv

The increasing availability of Earth observation data offers unprecedented opportunities for large-scale environmental monitoring and analysis. However, these datasets are inherently heterogeneous, stemming from diverse …

Unsupervised Domain Adaptation Semantic Segmentation