Sparse Deformable Mamba for Hyperspectral Image Classification
Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba) approach for enhanced HSI classification, with the following contributions. First, to enhance Mamba sequence, an efficient Sparse Deformable Sequencing (SDS) approach is designed to adaptively learn the ''optimal" sequence, leading to sparse and deformable Mamba sequence with increased detail preservation and decreased computations. Second, to boost spatial-spectral feature learning, based on SDS, a Sparse Deformable Spatial Mamba Module (SDSpaM) and a Sparse Deformable Spectral Mamba Module (SDSpeM) are designed for tailored modeling of the spatial information spectral information. Last, to improve the fusion of SDSpaM and SDSpeM, an attention based feature fusion approach is designed to integrate the outputs of the SDSpaM and SDSpeM. The proposed method is tested on several benchmark datasets with many state-of-the-art approaches, demonstrating that the proposed approach can achieve higher accuracy with less computation, and better detail small-class preservation capability.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationHyperspectral Image Classificationimage-classificationImage ClassificationMambaMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
DCT-Mamba3D: Spectral Decorrelation and Spatial-Spectral Feature Extraction for Hyperspectral Image Classification
Hyperspectral image classification presents challenges due to spectral redundancy and complex spatial-spectral dependencies. This paper proposes a novel framework, DCT-Mamba3D, for hyperspectral image classification. DCT…
Hyperspectral Image Classificationimage-classificationImage ClassificationMambaMVNet: Hyperspectral Remote Sensing Image Classification Based on Hybrid Mamba-Transformer Vision Backbone Architecture
Hyperspectral image (HSI) classification faces challenges such as high-dimensional data, limited training samples, and spectral redundancy, which often lead to overfitting and insufficient generalization capability. This…
Computational EfficiencyHyperspectral Image Classificationimage-classificationImage Classification+2S$^2$Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification
Land cover analysis using hyperspectral images (HSI) remains an open problem due to their low spatial resolution and complex spectral information. Recent studies are primarily dedicated to designing Transformer-based arc…
Hyperspectral Image Classificationimage-classificationImage ClassificationMamba+1MambaHSI: Spatial-Spectral Mamba for Hyperspectral Image Classification
Transformer has been extensively explored for hyperspectral image (HSI) classification. However, transformer poses challenges in terms of speed and memory usage because of its quadratic computational complexity. Recently…
ClassificationHyperspectral Image Classificationimage-classificationImage Classification+1DefMamba: Deformable Visual State Space Model
Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing …
Computational Efficiencyimage-classificationImage ClassificationInstance Segmentation+6