Multimodal Image Matching based on Frequency-domain Information of Local Energy Response
Complicated nonlinear intensity differences, nonlinear local geometric distortions, noises and rotation transformation are main challenges in multimodal image matching. In order to solve these problems, we propose a method based on Frequency-domain Information of Local Energy Response called FILER. The core of FILER is the local energy response model based on frequency-domain information, which can overcome the effect of nonlinear intensity differences. To improve the robustness to local nonlinear geometric distortions and noises, we design a new edge structure enhanced feature detector and convolutional feature weighted descriptor, respectively. In addition, FILER overcomes the sensitivity of the frequency-domain information to the rotation angle and achieves rotation invariance. Extensive experiments multimodal image pairs show that FILER outperforms other state-of-the-art algorithms and has good robustness and universality.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Frequency-Aware Flow Matching for High-Quality Image Generation
Flow matching models have emerged as a powerful framework for realistic image generation by learning to reverse a corruption process that progressively adds Gaussian noise. However, because noise is injected in the laten…
Image GenerationTask-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusion
Multimodal Image Fusion (MMIF) aims to integrate complementary information from different imaging modalities to overcome the limitations of individual sensors. It enhances image quality and facilitates downstream applica…
Frequency-Aware Vision-Language Multimodality Generalization Network for Remote Sensing Image Classification
The booming remote sensing (RS) technology is giving rise to a novel multimodality generalization task, which requires the model to overcome data heterogeneity while possessing powerful cross-scene generalization ability…
Remote Sensing Image ClassificationFast and Robust Matching for Multimodal Remote Sensing Image Registration
While image registration has been studied in remote sensing community for decades, registering multimodal data [e.g., optical, LiDAR, SAR, and map] remains a challenging problem because of significant nonlinear intensity…
Computational EfficiencyImage RegistrationTemplate MatchingFrequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation
Flow matching has emerged as a standard paradigm for robotic manipulation owing to its strong expressive power for modelling complex, multimodal action distributions, alongside similar approaches like diffusion policy. H…