Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)
Unsupervised multimodal change detection is pivotal for time-sensitive tasks and comprehensive multi-temporal Earth monitoring. In this study, we explore unsupervised multimodal change detection between two key remote sensing data sources: optical high-resolution imagery and OpenStreetMap (OSM) data. Specifically, we propose to utilize the vision foundation model Segmentation Anything Model (SAM), for addressing our task. Leveraging SAM's exceptional zero-shot transfer capability, high-quality segmentation maps of optical images can be obtained. Thus, we can directly compare these two heterogeneous data forms in the so-called segmentation domain. We then introduce two strategies for guiding SAM's segmentation process: the 'no-prompt' and 'box/mask prompt' methods. The two strategies are designed to detect land-cover changes in general scenarios and to identify new land-cover objects within existing backgrounds, respectively. Experimental results on three datasets indicate that the proposed approach can achieve more competitive results compared to representative unsupervised multimodal change detection methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Change DetectionSegmentationSimilar Papers 제목 키워드 기반
Deep few-shot learning for bi-temporal building change detection
In real-world applications (e.g., change detection), annotating images is very expensive. To build effective deep learning models in these applications, deep few-shot learning methods have been developed and prove to be …
Change DetectionFew-Shot LearningSupervising Remote Sensing Change Detection Models with 3D Surface Semantics
Remote sensing change detection, identifying changes between scenes of the same location, is an active area of research with a broad range of applications. Recent advances in multimodal self-supervised pretraining have r…
Change DetectionRepresentation LearningChange Detection in Heterogeneous Optical and SAR Remote Sensing Images via Deep Homogeneous Feature Fusion
Change detection in heterogeneous remote sensing images is crucial for disaster damage assessment. Recent methods use homogenous transformation, which transforms the heterogeneous optical and SAR remote sensing images in…
Change DetectionStyle TransferA Light-Weight Object Detection Framework with FPA Module for Optical Remote Sensing Imagery
With the development of remote sensing technology, the acquisition of remote sensing images is easier and easier, which provides sufficient data resources for the task of detecting remote sensing objects. However, how to…
Objectobject-detectionObject DetectionHigh-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning
With the development of remote sensing technology, high-resolution (HR) remote sensing optical images have gradually become the main source of change detection data. Albeit, the change detection for HR remote sensing ima…
Change DetectionDomain Adaptation