paper-with-me

홈 › Papers

Transformers Meet Hyperspectral Imaging: A Comprehensive Study of Models, Challenges and Open Problems

2025-06-10 · Guyang Zhang, Waleed Abdulla

Transformers have become the architecture of choice for learning long-range dependencies, yet their adoption in hyperspectral imaging (HSI) is still emerging. We reviewed more than 300 papers published up to 2025 and present the first end-to-end survey dedicated to Transformer-based HSI classification. The study categorizes every stage of a typical pipeline-pre-processing, patch or pixel tokenization, positional encoding, spatial-spectral feature extraction, multi-head self-attention variants, skip connections, and loss design-and contrasts alternative design choices with the unique spatial-spectral properties of HSI. We map the field's progress against persistent obstacles: scarce labeled data, extreme spectral dimensionality, computational overhead, and limited model explainability. Finally, we outline a research agenda prioritizing valuable public data sets, lightweight on-edge models, illumination and sensor shifts robustness, and intrinsically interpretable attention mechanisms. Our goal is to guide researchers in selecting, combining, or extending Transformer components that are truly fit for purpose for next-generation HSI applications.

📄 PDF Abstract BibTeX arXiv:2506.08596

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…

Similar Papers 제목 키워드 기반

A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging

2021-06-30 · Jingang Zhang, Runmu Su, Wenqi Ren, Qiang Fu 외

Hyperspectral imaging enables versatile applications due to its competence in capturing abundant spatial and spectral information, which are crucial for identifying substances. However, the devices for acquiring hyperspe…

Spectral Reconstruction

Hyperspectral Image Segmentation: A Preliminary Study on the Oral and Dental Spectral Image Database (ODSI-DB)

2023-03-14 · Luis C. Garcia-Peraza-Herrera, Conor Horgan, Sebastien Ourselin, Michael Ebner 외

Visual discrimination of clinical tissue types remains challenging, with traditional RGB imaging providing limited contrast for such tasks. Hyperspectral imaging (HSI) is a promising technology providing rich spectral in…

Hyperspectral Image SegmentationImage SegmentationSemantic Segmentation

RGB to Hyperspectral: Spectral Reconstruction for Enhanced Surgical Imaging

2024-10-17 · Tobias Czempiel, Alfie Roddan, Maria Leiloglou, Zepeng Hu 외

This study investigates the reconstruction of hyperspectral signatures from RGB data to enhance surgical imaging, utilizing the publicly available HeiPorSPECTRAL dataset from porcine surgery and an in-house neurosurgery …

Decision MakingSpectral ReconstructionSSIM

Dense Dispersed Structured Light for Hyperspectral 3D Imaging of Dynamic Scenes

2024-12-02 · CVPR 2025 1 · Suhyun Shin, Seungwoo Yoon, Ryota Maeda, Seung-Hwan Baek

Hyperspectral 3D imaging captures both depth maps and hyperspectral images, enabling comprehensive geometric and material analysis. Recent methods achieve high spectral and depth accuracy; however, they require long acqu…

Hyperspectral Imaging Technology and Transfer Learning Utilized in Identification Haploid Maize Seeds

2018-05-30 · Wen-Xuan Liao, Xuan-Yu Wang, Dong An, Yao-Guang Wei

It is extremely important to correctly identify the cultivars of maize seeds in the breeding process of maize. In this paper, the transfer learning as a method of deep learning is adopted to establish a model by combinin…

Transfer Learning