paper-with-me

Papers

Dynamic Memory-enhanced Transformer for Hyperspectral Image Classification

2025-04-17 · Muhammad Ahmad, Manuel Mazzara, Salvatore Distefano, Adil Mehmood Khan

Hyperspectral image (HSI) classification remains a challenging task due to the intricate spatial-spectral correlations. Existing transformer models excel in capturing long-range dependencies but often suffer from information redundancy and attention inefficiencies, limiting their ability to model fine-grained relationships crucial for HSI classification. To overcome these limitations, this work proposes MemFormer, a lightweight and memory-enhanced transformer. MemFormer introduces a memory-enhanced multi-head attention mechanism that iteratively refines a dynamic memory module, enhancing feature extraction while reducing redundancy across layers. Additionally, a dynamic memory enrichment strategy progressively captures complex spatial and spectral dependencies, leading to more expressive feature representations. To further improve structural consistency, we incorporate a spatial-spectral positional encoding (SSPE) tailored for HSI data, ensuring continuity without the computational burden of convolution-based approaches. Extensive experiments on benchmark datasets demonstrate that MemFormer achieves superior classification accuracy, outperforming state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2504.13242

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationHyperspectral Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis

2024-07-23 · Fangqin Zhou, Mert Kilickaya, Joaquin Vanschoren, Ran Piao

Hyperspectral Imaging (HSI) plays an increasingly critical role in precise vision tasks within remote sensing, capturing a wide spectrum of visual data. Transformer architectures have significantly enhanced HSI task perf…

Model Discovery

Spectral-Enhanced Transformers: Leveraging Large-Scale Pretrained Models for Hyperspectral Object Tracking

2025-02-26 · Shaheer Mohamed, Tharindu Fernando, Sridha Sridharan, Peyman Moghadam 외

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Usin…

ObjectObject Tracking

Transformer for Multitemporal Hyperspectral Image Unmixing

2024-07-15 · Hang Li, Qiankun Dong, Xueshuo Xie, Xia Xu 외

Multitemporal hyperspectral image unmixing (MTHU) holds significant importance in monitoring and analyzing the dynamic changes of surface. However, compared to single-temporal unmixing, the multitemporal approach demands…

Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoising

2023-04-03 · CVPR 2023 1 · Miaoyu Li, Ji Liu, Ying Fu, Yulun Zhang 외

Denoising is a crucial step for hyperspectral image (HSI) applications. Though witnessing the great power of deep learning, existing HSI denoising methods suffer from limitations in capturing the non-local self-similarit…

DenoisingHyperspectral Image DenoisingImage Denoising

GEWDiff: Geometric Enhanced Wavelet-based Diffusion Model for Hyperspectral Image Super-resolution

2025-11-10 · Sirui Wang, Jiang He, Natàlia Blasco Andreo, Xiao Xiang Zhu arxiv

Improving the quality of hyperspectral images (HSIs), such as through super-resolution, is a crucial research area. However, generative modeling for HSIs presents several challenges. Due to their high spectral dimensiona…

Image Super-Resolution