paper-with-me

홈 › Papers

Exchanging Dual Encoder-Decoder: A New Strategy for Change Detection with Semantic Guidance and Spatial Localization

2023-11-19 · Sijie Zhao, Xueliang Zhang, Pengfeng Xiao, Guangjun He

Change detection is a critical task in earth observation applications. Recently, deep learning-based methods have shown promising performance and are quickly adopted in change detection. However, the widely used multiple encoder and single decoder (MESD) as well as dual encoder-decoder (DED) architectures still struggle to effectively handle change detection well. The former has problems of bitemporal feature interference in the feature-level fusion, while the latter is inapplicable to intraclass change detection and multiview building change detection. To solve these problems, we propose a new strategy with an exchanging dual encoder-decoder structure for binary change detection with semantic guidance and spatial localization. The proposed strategy solves the problems of bitemporal feature inference in MESD by fusing bitemporal features in the decision level and the inapplicability in DED by determining changed areas using bitemporal semantic features. We build a binary change detection model based on this strategy, and then validate and compare it with 18 state-of-the-art change detection methods on six datasets in three scenarios, including intraclass change detection datasets (CDD, SYSU), single-view building change detection datasets (WHU, LEVIR-CD, LEVIR-CD+) and a multiview building change detection dataset (NJDS). The experimental results demonstrate that our model achieves superior performance with high efficiency and outperforms all benchmark methods with F1-scores of 97.77%, 83.07%, 94.86%, 92.33%, 91.39%, 74.35% on CDD, SYSU, WHU, LEVIR-CD, LEVIR- CD+, and NJDS datasets, respectively. The code of this work will be available at https://github.com/NJU-LHRS/official-SGSLN.

📄 PDF Abstract BibTeX arXiv:2311.11302

Code (1)

walking-shadow/Semantic-guidance-and-spatial-localization-network 공식 구현 pytorch

Tasks

Change DetectionDecoderEarth Observation

Similar Papers 제목 키워드 기반

Exchanging-based Multimodal Fusion with Transformer

2023-09-05 · Renyu Zhu, Chengcheng Han, Yong Qian, Qiushi Sun 외

We study the problem of multimodal fusion in this paper. Recent exchanging-based methods have been proposed for vision-vision fusion, which aim to exchange embeddings learned from one modality to the other. However, most…

Image CaptioningImage GenerationMultimodal Sentiment Analysisnamed-entity-recognition+4

A Cross-Hierarchical Difference Feature Fusion Network Based on Multiscale Encoder-Decoder for Hyperspectral Change Detection

2025-09-21 · Mingshuai Sheng, Bhatti Uzair Aslam, Junfeng Zhang, Siling Feng 외 arxiv

Hyperspectral change detection (HCD) is one of the core applications of remote sensing images, holding significant research value in fields like environmental monitoring and disaster assessment. However, existing methods…

Change Detection

EoCD: Encoder only Remote Sensing Change Detection

2026-02-05 · Mubashir Noman, Mustansar Fiaz, Hiyam Debary, Abdul Hannan 외 arxiv

Being a cornerstone of temporal analysis, change detection has been playing a pivotal role in modern earth observation. Existing change detection methods rely on the Siamese encoder to individually extract temporal featu…

Change Detection

CoMiX: Cross-Modal Fusion with Deformable Convolutions for HSI-X Semantic Segmentation

2024-11-13 · Xuming Zhang, Xingfa Gu, Qingjiu Tian, Lorenzo Bruzzone

Improving hyperspectral image (HSI) semantic segmentation by exploiting complementary information from a supplementary data type (referred to X-modality) is promising but challenging due to differences in imaging sensors…

DecoderSemantic Segmentation

DeepInteraction++: Multi-Modality Interaction for Autonomous Driving

2024-08-09 · Zeyu Yang, Nan Song, Wei Li, Xiatian Zhu 외

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-spec…

3D Object DetectionAutonomous DrivingDecoderobject-detection+2