paper-with-me

Papers

Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoising

2023-04-03 · CVPR 2023 1 · Miaoyu Li, Ji Liu, Ying Fu, Yulun Zhang, Dejing Dou

Denoising is a crucial step for hyperspectral image (HSI) applications. Though witnessing the great power of deep learning, existing HSI denoising methods suffer from limitations in capturing the non-local self-similarity. Transformers have shown potential in capturing long-range dependencies, but few attempts have been made with specifically designed Transformer to model the spatial and spectral correlation in HSIs. In this paper, we address these issues by proposing a spectral enhanced rectangle Transformer, driving it to explore the non-local spatial similarity and global spectral low-rank property of HSIs. For the former, we exploit the rectangle self-attention horizontally and vertically to capture the non-local similarity in the spatial domain. For the latter, we design a spectral enhancement module that is capable of extracting global underlying low-rank property of spatial-spectral cubes to suppress noise, while enabling the interactions among non-overlapping spatial rectangles. Extensive experiments have been conducted on both synthetic noisy HSIs and real noisy HSIs, showing the effectiveness of our proposed method in terms of both objective metric and subjective visual quality. The code is available at https://github.com/MyuLi/SERT.

📄 PDF Abstract BibTeX arXiv:2304.00844

Code (1)

myuli/sert 공식 구현 pytorch

Tasks

DenoisingHyperspectral Image DenoisingImage Denoising

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Cross-Scope Spatial-Spectral Information Aggregation for Hyperspectral Image Super-Resolution

2023-11-29 · Shi Chen, Lefei Zhang, Liangpei Zhang

Hyperspectral image super-resolution has attained widespread prominence to enhance the spatial resolution of hyperspectral images. However, convolution-based methods have encountered challenges in harnessing the global s…

Hyperspectral Image Super-ResolutionImage Super-ResolutionSuper-Resolution

HyTAS: A Hyperspectral Image Transformer Architecture Search Benchmark and Analysis

2024-07-23 · Fangqin Zhou, Mert Kilickaya, Joaquin Vanschoren, Ran Piao

Hyperspectral Imaging (HSI) plays an increasingly critical role in precise vision tasks within remote sensing, capturing a wide spectrum of visual data. Transformer architectures have significantly enhanced HSI task perf…

Model Discovery

Spectral-Enhanced Transformers: Leveraging Large-Scale Pretrained Models for Hyperspectral Object Tracking

2025-02-26 · Shaheer Mohamed, Tharindu Fernando, Sridha Sridharan, Peyman Moghadam 외

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Usin…

ObjectObject Tracking

Dynamic Memory-enhanced Transformer for Hyperspectral Image Classification

2025-04-17 · Muhammad Ahmad, Manuel Mazzara, Salvatore Distefano, Adil Mehmood Khan

Hyperspectral image (HSI) classification remains a challenging task due to the intricate spatial-spectral correlations. Existing transformer models excel in capturing long-range dependencies but often suffer from informa…

ClassificationHyperspectral Image Classificationimage-classificationImage Classification

In2SET: Intra-Inter Similarity Exploiting Transformer for Dual-Camera Compressive Hyperspectral Imaging

2023-12-20 · CVPR 2024 1 · Xin Wang, Lizhi Wang, Xiangtian Ma, Maoqing Zhang 외

Dual-Camera Compressed Hyperspectral Imaging (DCCHI) offers the capability to reconstruct 3D Hyperspectral Image (HSI) by fusing compressive and Panchromatic (PAN) image, which has shown great potential for snapshot hype…