paper-with-me

Papers

Hyperspectral Image Classification via Transformer-based Spectral-Spatial Attention Decoupling and Adaptive Gating

2025-06-10 · Guandong Li, Mengxia Ye

Deep neural networks face several challenges in hyperspectral image classification, including high-dimensional data, sparse distribution of ground objects, and spectral redundancy, which often lead to classification overfitting and limited generalization capability. To more effectively extract and fuse spatial context with fine spectral information in hyperspectral image (HSI) classification, this paper proposes a novel network architecture called STNet. The core advantage of STNet stems from the dual innovative design of its Spatial-Spectral Transformer module: first, the fundamental explicit decoupling of spatial and spectral attention ensures targeted capture of key information in HSI; second, two functionally distinct gating mechanisms perform intelligent regulation at both the fusion level of attention flows (adaptive attention fusion gating) and the internal level of feature transformation (GFFN). This characteristic demonstrates superior feature extraction and fusion capabilities compared to traditional convolutional neural networks, while reducing overfitting risks in small-sample and high-noise scenarios. STNet enhances model representation capability without increasing network depth or width. The proposed method demonstrates superior performance on IN, UP, and KSC datasets, outperforming mainstream hyperspectral image classification approaches.

📄 PDF Abstract BibTeX arXiv:2506.08324

Code (1)

leeguandong/STNet-for-HSI 공식 구현 pytorch

Tasks

ClassificationHyperspectral Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

MultiScale Spectral-Spatial Convolutional Transformer for Hyperspectral Image Classification

2023-10-28 · Zhiqiang Gong, Xian Zhou, Wen Yao

Due to the powerful ability in capturing the global information, Transformer has become an alternative architecture of CNNs for hyperspectral image classification. However, general Transformer mainly considers the global…

ClassificationHyperspectral Image Classificationimage-classificationImage Classification

SpecSwin3D: Generating Hyperspectral Imagery from Multispectral Data via Transformer Networks

2025-09-07 · Tang Sui, Songxi Yang, Qunying Huang arxiv

Multispectral and hyperspectral imagery are widely used in agriculture, environmental monitoring, and urban planning due to their complementary spatial and spectral characteristics. A fundamental trade-off persists: mult…

FactoFormer: Factorized Hyperspectral Transformers with Self-Supervised Pretraining

2023-09-18 · Shaheer Mohamed, Maryam Haghighat, Tharindu Fernando, Sridha Sridharan 외

Hyperspectral images (HSIs) contain rich spectral and spatial information. Motivated by the success of transformers in the field of natural language processing and computer vision where they have shown the ability to lea…

Transformers Fusion across Disjoint Samples for Hyperspectral Image Classification

2024-05-02 · Muhammad Ahmad, Manuel Mazzara, Salvatore Distifano

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes …

Hyperspectral Image Classificationimage-classificationImage Classification

DiffFormer: a Differential Spatial-Spectral Transformer for Hyperspectral Image Classification

2024-12-23 · Muhammad Ahmad, Manuel Mazzara, Salvatore Distefano, Adil Mehmood Khan 외

Hyperspectral image classification (HSIC) has gained significant attention because of its potential in analyzing high-dimensional data with rich spectral and spatial information. In this work, we propose the Differential…

Computational EfficiencyHyperspectral Image Classificationimage-classificationImage Classification+1