paper-with-me

홈 › Papers

Unveiling the potential of diffusion model-based framework with transformer for hyperspectral image classification

2024-04-10 · Nature Scientific Reports 2024 4 · Neetu Sigger, Quoc-Tuan Vien, Sinh Van Nguyen, Gianluca Tozzi & Tuan Thanh Nguyen

Hyperspectral imaging has gained popularity for analysing remotely sensed images in various fields such as agriculture and medical. However, existing models face challenges in dealing with the complex relationships and characteristics of spectral–spatial data due to the multi-band nature and data redundancy of hyperspectral data. To address this limitation, we propose a novel approach called DiffSpectralNet, which combines diffusion and transformer techniques. The diffusion method is able extract diverse and meaningful spectral–spatial features, leading to improvement in HSI classification. Our approach involves training an unsupervised learning framework based on the diffusion model to extract high-level and low-level spectral–spatial features, followed by the extraction of intermediate hierarchical features from different timestamps for classification using a pre-trained denoising U-Net. Finally, we employ a supervised transformer-based classifier to perform the HSI classification. We conduct comprehensive experiments on three publicly available datasets to validate our approach. The results demonstrate that our framework significantly outperforms existing approaches, achieving state-of-the-art performance. The stability and reliability of our approach are demonstrated across various classes in all datasets.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

DenoisingHyperspectral Image Classificationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

DiffSpectralNet : Unveiling the Potential of Diffusion Models for Hyperspectral Image Classification

2023-10-29 · Neetu Sigger, Tuan Thanh Nguyen, Gianluca Tozzi, Quoc-Tuan Vien 외

Hyperspectral images (HSI) have become popular for analysing remotely sensed images in multiple domain like agriculture, medical. However, existing models struggle with complex relationships and characteristics of spectr…

ClassificationDenoisingHyperspectral Image Classificationimage-classification+1

Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpainting

2026-08-27 · Shuo Li, Mike Davies, Mehrdad Yaghoobi arxiv

A novel Hyperspectral diffusion Equivariant Imaging (HyDiff-EI) framework for solving the hyperspectral image (HSI) inpainting problem has been presented here. Unlike conventional diffusion-based methods that rely on lar…

Image Inpainting

HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models

2023-06-21 · Chanyue Wu, Dong Wang, Hanyu Mao, Ying Li

Despite the proven significance of hyperspectral images (HSIs) in performing various computer vision tasks, its potential is adversely affected by the low-resolution (LR) property in the spatial domain, resulting from mu…

DenoisingImage Super-ResolutionSuper-Resolution

HSR-Diff: Hyperspectral Image Super-Resolution via Conditional Diffusion Models

2023-01-01 · ICCV 2023 1 · Chanyue Wu, Dong Wang, Yunpeng Bai, Hanyu Mao 외

Despite the proven significance of hyperspectral images (HSIs) in performing various computer vision tasks, its potential is adversely affected by the low-resolution (LR) property in the spatial domain, resulting fro…

DenoisingHyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

Deep Spatially-Regularized and Superpixel-Based Diffusion Learning for Unsupervised Hyperspectral Image Clustering

2026-04-14 · Vutichart Buranasiri, James M. Murphy arxiv

An unsupervised framework for hyperspectral image (HSI) clustering is proposed that incorporates masked deep representation learning with diffusion-based clustering, extending the Spatially-Regularized Superpixel-based D…

Representation LearningImage Clustering