paper-with-me

홈 › Papers

CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detection

2024-06-06 · Haotian Zhang, Keyan Chen, Chenyang Liu, Hao Chen, Zhengxia Zou, Zhenwei Shi

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most methods enhance the global receptive field by directly modifying the scanning mode of Mamba, neglecting the crucial role that local information plays in dense prediction tasks (e.g., binary CD). In this article, we propose a model called CDMamba, which effectively combines global and local features for handling binary CD tasks. Specifically, the Scaled Residual ConvMamba (SRCM) block is proposed to utilize the ability of Mamba to extract global features and convolution to enhance the local details to alleviate the issue that current Mamba-based methods lack detailed clues and are difficult to achieve fine detection in dense prediction tasks. Furthermore, considering the characteristics of bi-temporal feature interaction required for CD, the Adaptive Global Local Guided Fusion (AGLGF) block is proposed to dynamically facilitate the bi-temporal interaction guided by other temporal global/local features. Our intuition is that more discriminative change features can be acquired with the guidance of other temporal features. Extensive experiments on five datasets demonstrate that our proposed CDMamba is comparable to the current methods (such as the F1/IoU scores are improved by 2.10%/3.00% and 2.44%/2.91% on LEVIR+CD and CLCD, respectively). Our code is open-sourced at https://github.com/zmoka-zht/CDMamba.

📄 PDF Abstract BibTeX arXiv:2406.04207

Code (3)

zmoka-zht/cdmamba 공식 구현 pytorch
chen-yang-liu/rscama pytorch
zmoka-zht/BiFA pytorch

Tasks

Change DetectionMambaState Space Models

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentation

2024-12-11 · Tapas Kumar Dutta, Snehashis Majhi, Deepak Ranjan Nayak, Debesh Jha

Polyp segmentation in colonoscopy is crucial for detecting colorectal cancer. However, it is challenging due to variations in the structure, color, and size of polyps, as well as the lack of clear boundaries with surroun…

MambaSegmentationZero-shot Generalization

Cross-attention Inspired Selective State Space Models for Target Sound Extraction

2024-09-07 · Donghang Wu, Yiwen Wang, Xihong Wu, Tianshu Qu

The Transformer model, particularly its cross-attention module, is widely used for feature fusion in target sound extraction which extracts the signal of interest based on given clues. Despite its effectiveness, this app…

Computational EfficiencyMambaState Space ModelsTarget Sound Extraction

LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model

2024-06-07 · CVPR 2024 1 · Dongkai Wang, Shiyu Xuan, Shiliang Zhang

The capacity of existing human keypoint localization models is limited by keypoint priors provided by the training data. To alleviate this restriction and pursue more general model, this work studies keypoint localizatio…

Language ModelingLanguage ModellingLarge Language Model

MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Tracking

2024-08-15 · Simiao Lai, Chang Liu, Jiawen Zhu, Ben Kang 외

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt i…

MambaRgb-T Tracking

EventMamba: Enhancing Spatio-Temporal Locality with State Space Models for Event-Based Video Reconstruction

2025-03-25 · Chengjie Ge, Xueyang Fu, Peng He, Kunyu Wang 외

Leveraging its robust linear global modeling capability, Mamba has notably excelled in computer vision. Despite its success, existing Mamba-based vision models have overlooked the nuances of event-driven tasks, especiall…

Event-Based Video ReconstructionMambaState Space ModelsVideo Reconstruction