paper-with-me

Papers

GlobalMind: Global Multi-head Interactive Self-attention Network for Hyperspectral Change Detection

2023-04-18 · Meiqi Hu, Chen Wu, Liangpei Zhang

High spectral resolution imagery of the Earth's surface enables users to monitor changes over time in fine-grained scale, playing an increasingly important role in agriculture, defense, and emergency response. However, most current algorithms are still confined to describing local features and fail to incorporate a global perspective, which limits their ability to capture interactions between global features, thus usually resulting in incomplete change regions. In this paper, we propose a Global Multi-head INteractive self-attention change Detection network (GlobalMind) to explore the implicit correlation between different surface objects and variant land cover transformations, acquiring a comprehensive understanding of the data and accurate change detection result. Firstly, a simple but effective Global Axial Segmentation (GAS) strategy is designed to expand the self-attention computation along the row space or column space of hyperspectral images, allowing the global connection with high efficiency. Secondly, with GAS, the global spatial multi-head interactive self-attention (Global-M) module is crafted to mine the abundant spatial-spectral feature involving potential correlations between the ground objects from the entire rich and complex hyperspectral space. Moreover, to acquire the accurate and complete cross-temporal changes, we devise a global temporal interactive multi-head self-attention (GlobalD) module which incorporates the relevance and variation of bi-temporal spatial-spectral features, deriving the integrate potential same kind of changes in the local and global range with the combination of GAS. We perform extensive experiments on five mostly used hyperspectral datasets, and our method outperforms the state-of-the-art algorithms with high accuracy and efficiency.

📄 PDF Abstract BibTeX arXiv:2304.08687

Code (0)

등록된 구현이 없습니다.

Tasks

Change Detection

Methods 이 논문이 사용한 방법론

fail 설명 없음

Similar Papers 제목 키워드 기반

Interactive Multi-Head Self-Attention with Linear Complexity

2024-02-27 · Hankyul Kang, Ming-Hsuan Yang, Jongbin Ryu

We propose an efficient interactive method for multi-head self-attention via decomposition. For existing methods using multi-head self-attention, the attention operation of each head is computed independently. However, w…

EIT: Enhanced Interactive Transformer

2022-12-20 · Tong Zheng, Bei Li, Huiwen Bao, Tong Xiao 외

Two principles: the complementary principle and the consensus principle are widely acknowledged in the literature of multi-view learning. However, the current design of multi-head self-attention, an instance of multi-vie…

Abstractive Text SummarizationLanguage ModelingLanguage ModellingMachine Translation+2

Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection

2022-07-28 · Xiaoqian Wu, Yong-Lu Li, Xinpeng Liu, Junyi Zhang 외

Human-Object Interaction (HOI) detection plays a crucial role in activity understanding. Though significant progress has been made, interactiveness learning remains a challenging problem in HOI detection: existing method…

Human-Object Interaction Detection

Mixed Multi-Head Self-Attention for Neural Machine Translation

2019-11-01 · WS 2019 11 · Hongyi Cui, Shohei Iida, Po-Hsuan Hung, Takehito Utsuro 외

Recently, the Transformer becomes a state-of-the-art architecture in the filed of neural machine translation (NMT). A key point of its high-performance is the multi-head self-attention which is supposed to allow the mode…

Machine TranslationNMTTranslation

Language Models can Self-Improve at State-Value Estimation for Better Search

2025-03-04 · Ethan Mendes, Alan Ritter

Collecting ground truth task completion rewards or human demonstrations for multi-step reasoning tasks is often cost-prohibitive and time-consuming, especially in interactive domains like web tasks. To address this bottl…

Language ModelingLanguage Modelling