Seg2Change: Adapting Open-Vocabulary Semantic Segmentation Model for Remote Sensing Change Detection
Change detection is a fundamental task in remote sensing, aiming to quantify the impacts of human activities and ecological dynamics on land-cover changes. Existing change detection methods are limited to predefined classes in training datasets, which constrains their scalability in real-world scenarios. In recent years, numerous advanced open-vocabulary semantic segmentation models have emerged for remote sensing imagery. However, there is still a lack of an effective framework for directly applying these models to open-vocabulary change detection (OVCD), a novel task that integrates vision and language to detect changes across arbitrary categories. To address these challenges, we first construct a category-agnostic change detection dataset, termed CA-CDD. Further, we design a category-agnostic change head to detect the transitions of arbitrary categories and index them to specific classes. Based on them, we propose Seg2Change, an adapter designed to adapt open-vocabulary semantic segmentation models to change detection task. Without bells and whistles, this simple yet effective framework achieves state-of-the-art OVCD performance (+9.52 IoU on WHU-CD and +5.50 mIoU on SECOND). Our code is released at https://github.com/yogurts-sy/Seg2Change.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic SegmentationChange DetectionSimilar Papers 제목 키워드 기반
Semantic Alignment in Hyperbolic Space for Open-Vocabulary Semantic Segmentation
Open-vocabulary semantic segmentation requires adapting image-level vision-language models such as CLIP to dense pixel-level prediction, which is challenging due to the mismatch between hierarchical structure and semanti…
Semantic SegmentationSegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Images
Most existing methods for training-free open-vocabulary semantic segmentation are based on CLIP. While these approaches have made progress, they often face challenges in precise localization or require complex pipelines …
3D Semantic Segmentation2D Semantic SegmentationChange DetectionAdapting Vision-Language Model with Fine-grained Semantics for Open-Vocabulary Segmentation
Despite extensive research, open-vocabulary segmentation methods still struggle to generalize across diverse domains. To reduce the computational cost of adapting Vision-Language Models (VLMs) while preserving their pre-…
Language ModelingLanguage ModellingOpen Vocabulary Panoptic SegmentationPanoptic SegmentationSemantic-CD: Remote Sensing Image Semantic Change Detection towards Open-vocabulary Setting
Remote sensing image semantic change detection is a method used to analyze remote sensing images, aiming to identify areas of change as well as categorize these changes within images of the same location taken at differe…
Change DetectionDecoderMulti-Task LearningTest-Time Adaptation of Vision-Language Models for Open-Vocabulary Semantic Segmentation
Recently, test-time adaptation has attracted wide interest in the context of vision-language models for image classification. However, to the best of our knowledge, the problem is completely overlooked in dense predictio…
image-classificationImage ClassificationOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic Segmentation+3