paper-with-me

홈 › Papers

Transformers Fusion across Disjoint Samples for Hyperspectral Image Classification

2024-05-02 · Muhammad Ahmad, Manuel Mazzara, Salvatore Distifano

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling long-range dependencies through self-attention mechanisms. Therefore, this paper introduces a novel method: an attentional fusion of these two transformers to significantly enhance the classification performance of Hyperspectral Images (HSIs). What sets this approach apart is its emphasis on the integration of attentional mechanisms from both architectures. This integration not only refines the modeling of spatial and spectral information but also contributes to achieving more precise and accurate classification results. The experimentation and evaluation of benchmark HSI datasets underscore the importance of employing disjoint training, validation, and test samples. The results demonstrate the effectiveness of the fusion approach, showcasing its superiority over traditional methods and individual transformers. Incorporating disjoint samples enhances the robustness and reliability of the proposed methodology, emphasizing its potential for advancing hyperspectral image classification.

📄 PDF Abstract BibTeX arXiv:2405.01095

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperspectral Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Position-Wise Feed-Forward Layer 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification

2024-05-20 · Weilian Zhou, Sei-ichiro Kamata, Haipeng Wang, Man-Sing Wong 외

Hyperspectral image (HSI) classification is pivotal in the remote sensing (RS) field, particularly with the advancement of deep learning techniques. Sequential models, adapted from the natural language processing (NLP) f…

Hyperspectral Image Classificationimage-classificationImage ClassificationMamba

Spectral-Enhanced Transformers: Leveraging Large-Scale Pretrained Models for Hyperspectral Object Tracking

2025-02-26 · Shaheer Mohamed, Tharindu Fernando, Sridha Sridharan, Peyman Moghadam 외

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Usin…

ObjectObject Tracking

Importance of Disjoint Sampling in Conventional and Transformer Models for Hyperspectral Image Classification

2024-04-23 · Muhammad Ahmad, Manuel Mazzara, Salvatore Distifano

Disjoint sampling is critical for rigorous and unbiased evaluation of state-of-the-art (SOTA) models. When training, validation, and test sets overlap or share data, it introduces a bias that inflates performance metrics…

BenchmarkingHyperspectral Image Classificationimage-classificationImage Classification

HHTrack: Hyperspectral Object Tracking Using Hybrid Attention

2023-08-14 · Yuedong Tan

Hyperspectral imagery provides abundant spectral information beyond the visible RGB bands, offering rich discriminative details about objects in a scene. Leveraging such data has the potential to enhance visual tracking …

ObjectObject TrackingRepresentation LearningVisual Tracking

Hyperspectral Image Generation with Unmixing Guided Diffusion Model

2025-06-03 · Shiyu Shen, Bin Pan, Ziye Zhang, Zhenwei Shi

Recently, hyperspectral image generation has received increasing attention, but existing generative models rely on conditional generation schemes, which limits the diversity of generated images. Diffusion models are popu…

Hyperspectral UnmixingImage GenerationmodelUnity