paper-with-me

Papers

Local Window Attention Transformer for Polarimetric SAR Image Classification

2023-01-23 · IEEE Geoscience and Remote Sensing Letters 2023 1 · Ali Jamali, Swalpa Kumar Roy, Avik Bhattacharya, Pedram Ghamisi

Convolutional neural networks (CNNs) have recently found great attention in image classification since deep CNNs have exhibited excellent performance in computer vision. Owing to their immense success, of late, scientists are exploring the functionality of transformers in Earth observation applications. Nevertheless, the primary issue with transformers is that they demand significantly more training data than CNN classifiers. Thus, the use of these transformers in remote sensing is considered challenging, notably in utilizing polarimetric SAR (PolSAR) data, due to the insufficient number of existing labeled data. In this letter, we develop and propose a vision transformer-based framework that utilizes 3D and 2D CNNs as feature extractors and, in addition, local window attention for the effective classification of PolSAR data. Extensive experimental results demonstrated that the developed model PolSARFormer obtained better classification accuracy than the state-of-the-art vision Swin Transformer and FNet algorithms. The PolSARFormer outperformed the Swin Transformer and FNet by the margin of 5.86% and 17.63%, in terms of average accuracy in the San Francisco data benchmark. Moreover , the results over the Flevoland dataset illustrated that the PolSARFormer exceeds several other algorithms, including the ResNet (97.49%), Swin Transformer (96.54%), FNet (95.28%), 2D CNN (94.57%), and AlexNet (91.83%), with a kappa index of 99.30%. The code will be made available publicly at https://github.com/aj1365/PolSARFormer.

📄 PDF Abstract BibTeX

Code (1)

aj1365/PolSARFormer

Tasks

ClassificationEarth Observationimage-classificationImage Classification

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Cross Aggregation Transformer for Image Restoration

2022-11-24 · Zheng Chen, Yulun Zhang, Jinjin Gu, Yongbing Zhang 외

Recently, Transformer architecture has been introduced into image restoration to replace convolution neural network (CNN) with surprising results. Considering the high computational complexity of Transformer with global …

Image RestorationInductive Bias

Polarimetric PatchMatch Multi-View Stereo

2023-11-11 · Jinyu Zhao, Jumpei Oishi, Yusuke Monno, Masatoshi Okutomi

PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency. In this paper, we propose Polarimetric PatchMatch multi-view Stereo (PolarPMS), which is …

Stereo Matching

BOAT: Bilateral Local Attention Vision Transformer

2022-01-31 · Tan Yu, Gangming Zhao, Ping Li, Yizhou Yu

Vision Transformers achieved outstanding performance in many computer vision tasks. Early Vision Transformers such as ViT and DeiT adopt global self-attention, which is computationally expensive when the number of patche…

Hilbert-Guided Sparse Local Attention

2025-11-08 · Yunge Li, Lanyu Xu arxiv

The quadratic compute and memory costs of global self-attention severely limit its use in high-resolution images. Local attention reduces complexity by restricting attention to neighborhoods. Block-sparse kernels can fur…

EM-based Solutions for Covariance Structure Detection and Classification in Polarimetric SAR Images

2021-06-21 · Pia Addabbo, Filippo Biondi, Carmine Clemente, Sudan Han 외

This paper addresses the challenge of classifying polarimetric SAR images by leveraging the peculiar characteristics of the polarimetric covariance matrix (PCM). To this end, a general framework to solve a multiple hypot…