paper-with-me

Papers

Convolution and Attention Mixer for Synthetic Aperture Radar Image Change Detection

2023-09-21 · Haopeng Zhang, Zijing Lin, Feng Gao, Junyu Dong, Qian Du, Heng-Chao Li

Synthetic aperture radar (SAR) image change detection is a critical task and has received increasing attentions in the remote sensing community. However, existing SAR change detection methods are mainly based on convolutional neural networks (CNNs), with limited consideration of global attention mechanism. In this letter, we explore Transformer-like architecture for SAR change detection to incorporate global attention. To this end, we propose a convolution and attention mixer (CAMixer). First, to compensate the inductive bias for Transformer, we combine self-attention with shift convolution in a parallel way. The parallel design effectively captures the global semantic information via the self-attention and performs local feature extraction through shift convolution simultaneously. Second, we adopt a gating mechanism in the feed-forward network to enhance the non-linear feature transformation. The gating mechanism is formulated as the element-wise multiplication of two parallel linear layers. Important features can be highlighted, leading to high-quality representations against speckle noise. Extensive experiments conducted on three SAR datasets verify the superior performance of the proposed CAMixer. The source codes will be publicly available at https://github.com/summitgao/CAMixer .

📄 PDF Abstract BibTeX arXiv:2309.12010

Code (1)

summitgao/camixer 공식 구현 pytorch

Tasks

Change DetectionInductive Bias

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Synthetic Aperture Radar Image Change Detection via Layer Attention-Based Noise-Tolerant Network

2022-08-09 · Desen Meng, Feng Gao, Junyu Dong, Qian Du 외

Recently, change detection methods for synthetic aperture radar (SAR) images based on convolutional neural networks (CNN) have gained increasing research attention. However, existing CNN-based methods neglect the interac…

Change Detection

Efficient CNN-based Super Resolution Algorithms for mmWave Mobile Radar Imaging

2023-05-03 · Christos Vasileiou, Josiah W. Smith, Shiva Thiagarajan, Matthew Nigh 외

In this paper, we introduce an innovative super resolution approach to emerging modes of near-field synthetic aperture radar (SAR) imaging. Recent research extends convolutional neural network (CNN) architectures from th…

Image Super-ResolutionSuper-Resolution

3D Near-Field Millimeter-Wave Synthetic Aperture Radar Imaging

2020-11-01 · Shahrokh Hamidi, Safieddin Safavi-Naeini

In this paper, we present 3D high resolution radar imaging process at millimeter-Wave (mmWave) frequencies by creating the effect of a large aperture synthetically. We use a low cost fully integrated Frequency Modulated …

A Multiple Radar Approach for Automatic Target Recognition of Aircraft using Inverse Synthetic Aperture Radar

2017-11-14 · Carlos Pena-Caballero, Elifaleth Cantu, Jesus Rodriguez, Adolfo Gonzales 외

Along with the improvement of radar technologies, Automatic Target Recognition (ATR) using Synthetic Aperture Radar (SAR) and Inverse SAR (ISAR) has come to be an active research area. SAR/ISAR are radar techniques to ge…

Change Detection in Synthetic Aperture Radar Images Using a Dual-Domain Network

2021-04-14 · Xiaofan Qu, Feng Gao, Junyu Dong, Qian Du 외

Change detection from synthetic aperture radar (SAR) imagery is a critical yet challenging task. Existing methods mainly focus on feature extraction in spatial domain, and little attention has been paid to frequency doma…

Change Detection