Dynamic Frequency Feature Fusion Network for Multi-Source Remote Sensing Data Classification
Multi-source data classification is a critical yet challenging task for remote sensing image interpretation. Existing methods lack adaptability to diverse land cover types when modeling frequency domain features. To this end, we propose a Dynamic Frequency Feature Fusion Network (DFFNet) for hyperspectral image (HSI) and Synthetic Aperture Radar (SAR) / Light Detection and Ranging (LiDAR) data joint classification. Specifically, we design a dynamic filter block to dynamically learn the filter kernels in the frequency domain by aggregating the input features. The frequency contextual knowledge is injected into frequency filter kernels. Additionally, we propose spectral-spatial adaptive fusion block for cross-modal feature fusion. It enhances the spectral and spatial attention weight interactions via channel shuffle operation, thereby providing comprehensive cross-modal feature fusion. Experiments on two benchmark datasets show that our DFFNet outperforms state-of-the-art methods in multi-source data classification. The codes will be made publicly available at https://github.com/oucailab/DFFNet.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Spatial-Frequency Enhanced Mamba for Multi-Modal Image Fusion
Multi-Modal Image Fusion (MMIF) aims to integrate complementary image information from different modalities to produce informative images. Previous deep learning-based MMIF methods generally adopt Convolutional Neural Ne…
Image ReconstructionStep-adaptive multimodal fusion network with multi-scale cloud feature learning for ultra-short-term solar irradiance forecasting
Ultra-short-term solar irradiance prediction is critical for photovoltaic system dispatch and power grid stability. Existing approaches suffer from three key shortcomings: single time-series models cannot capture the spa…
Solar Irradiance ForecastingInteractive Spatial-Frequency Fusion Mamba for Multi-Modal Image Fusion
Multi-Modal Image Fusion (MMIF) aims to combine images from different modalities to produce fused images, retaining texture details and preserving significant information. Recently, some MMIF methods incorporate frequenc…
Image Fusion Using Quaternion Wavelet Transform and Multiple Features
Multi-scale-based image fusion is one of main fusion methods, in which multi-scale decomposition tool and feature extraction play very important roles. The quaternion wavelet transform (QWT) is one of the effective multi…
Rethinking Video Deblurring with Wavelet-Aware Dynamic Transformer and Diffusion Model
Current video deblurring methods have limitations in recovering high-frequency information since the regression losses are conservative with high-frequency details. Since Diffusion Models (DMs) have strong capabilities i…
DeblurringVideo Deblurring