paper-with-me

홈 › Papers

Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution

2023-11-29 · Shi Chen, Lefei Zhang, Liangpei Zhang

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global spatial-spectral information. The prevailing transformer-based methods have not adequately captured the long-range dependencies in both spectral and spatial dimensions. To alleviate this issue, we propose a novel cross-scope spatial-spectral Transformer (CST) to efficiently investigate long-range spatial and spectral similarities for single hyperspectral image super-resolution. Specifically, we devise cross-attention mechanisms in spatial and spectral dimensions to comprehensively model the long-range spatial-spectral characteristics. By integrating global information into the rectangle-window self-attention, we first design a cross-scope spatial self-attention to facilitate long-range spatial interactions. Then, by leveraging appropriately characteristic spatial-spectral features, we construct a cross-scope spectral self-attention to effectively capture the intrinsic correlations among global spectral bands. Finally, we elaborate a concise feed-forward neural network to enhance the feature representation capacity in the Transformer structure. Extensive experiments over three hyperspectral datasets demonstrate that the proposed CST is superior to other state-of-the-art methods both quantitatively and visually. The code is available at \url{https://github.com/Tomchenshi/CST.git}.

📄 PDF Abstract BibTeX arXiv:2311.17340

Code (1)

tomchenshi/cst 공식 구현 pytorch

Tasks

Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Object Detection in Hyperspectral Image via Unified Spectral-Spatial Feature Aggregation

2023-06-14 · Xiao He, Chang Tang, Xinwang Liu, Wei zhang 외

Deep learning-based hyperspectral image (HSI) classification and object detection techniques have gained significant attention due to their vital role in image content analysis, interpretation, and wider HSI applications…

Objectobject-detectionObject Detection

Boosting the Generalization Ability for Hyperspectral Image Classification using Spectral-spatial Axial Aggregation Transformer

2023-06-29 · Enzhe Zhao, Zhichang Guo, Shengzhu Shi, Yao Li 외

In the hyperspectral image classification (HSIC) task, the most commonly used model validation paradigm is partitioning the training-test dataset through pixel-wise random sampling. By training on a small amount of data,…

Hyperspectral Image Classificationimage-classificationImage Classification

Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering

2024-01-17 · Jingwei Guo, Kaizhu Huang, Xinping Yi, Zixian Su 외

Whilst spectral Graph Neural Networks (GNNs) are theoretically well-founded in the spectral domain, their practical reliance on polynomial approximation implies a profound linkage to the spatial domain. As previous studi…

Node Classification

GraphMamba: An Efficient Graph Structure Learning Vision Mamba for Hyperspectral Image Classification

2024-07-11 · Aitao Yang, Min Li, Yao Ding, Leyuan Fang 외

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become main…

Computational EfficiencyGraph structure learningHyperspectral Image Classificationimage-classification+2

Hierarchical Spatial-Frequency Aggregation for Spectral Deconvolution Imaging

2025-11-10 · Tao Lv, Daoming Zhou, Chenglong Huang, Chongde Zi 외 arxiv

Computational spectral imaging (CSI) achieves real-time hyperspectral imaging through co-designed optics and algorithms, but typical CSI methods suffer from a bulky footprint and limited fidelity. Therefore, Spectral Dec…