paper-with-me

홈 › Papers

RIFT: Multi-modal Image Matching Based on Radiation-invariant Feature Transform

2018-04-25 · Jiayuan Li, Qingwu Hu, Mingyao Ai

Traditional feature matching methods such as scale-invariant feature transform (SIFT) usually use image intensity or gradient information to detect and describe feature points; however, both intensity and gradient are sensitive to nonlinear radiation distortions (NRD). To solve the problem, this paper proposes a novel feature matching algorithm that is robust to large NRD. The proposed method is called radiation-invariant feature transform (RIFT). There are three main contributions in RIFT: first, RIFT uses phase congruency (PC) instead of image intensity for feature point detection. RIFT considers both the number and repeatability of feature points, and detects both corner points and edge points on the PC map. Second, RIFT originally proposes a maximum index map (MIM) for feature description. MIM is constructed from the log-Gabor convolution sequence and is much more robust to NRD than traditional gradient map. Thus, RIFT not only largely improves the stability of feature detection, but also overcomes the limitation of gradient information for feature description. Third, RIFT analyzes the inherent influence of rotations on the values of MIM, and realizes rotation invariance. We use six different types of multi-model image datasets to evaluate RIFT, including optical-optical, infrared-optical, synthetic aperture radar (SAR)-optical, depth-optical, map-optical, and day-night datasets. Experimental results show that RIFT is much more superior to SIFT and SAR-SIFT. To the best of our knowledge, RIFT is the first feature matching algorithm that can achieve good performance on all the above-mentioned types of multi-model images. The source code of RIFT and multi-modal remote sensing image datasets are made public .

📄 PDF Abstract BibTeX arXiv:1804.09493

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

pc 설명 없음

Similar Papers 제목 키워드 기반

RIFT2: Speeding-up RIFT with A New Rotation-Invariance Technique

2023-03-01 · Jiayuan Li, Pengcheng Shi, Qingwu Hu, Yongjun Zhang

Multimodal image matching is an important prerequisite for multisource image information fusion. Compared with the traditional matching problem, multimodal feature matching is more challenging due to the severe nonlinear…

R2FD2: Fast and Robust Matching of Multimodal Remote Sensing Image via Repeatable Feature Detector and Rotation-invariant Feature Descriptor

2022-12-05 · Bai Zhu, Chao Yang, Jinkun Dai, Jianwei Fan 외

Automatically identifying feature correspondences between multimodal images is facing enormous challenges because of the significant differences both in radiation and geometry. To address these problems, we propose a nov…

Multimodal Alignment of Histopathological Images Using Cell Segmentation and Point Set Matching for Integrative Cancer Analysis

2024-09-30 · Jun Jiang, Raymond Moore, Brenna Novotny, Leo Liu 외

Histopathological imaging is vital for cancer research and clinical practice, with multiplexed Immunofluorescence (MxIF) and Hematoxylin and Eosin (H&E) providing complementary insights. However, aligning different stain…

Cell SegmentationGraph Matchingset matching

Transformer-Based Local Feature Matching for Multimodal Image Registration

2024-04-25 · Remi Delaunay, Ruisi Zhang, Filipe C. Pedrosa, Navid Feizi 외

Ultrasound imaging is a cost-effective and radiation-free modality for visualizing anatomical structures in real-time, making it ideal for guiding surgical interventions. However, its limited field-of-view, speckle noise…

Image RegistrationPose Estimation

LLM-driven Multimodal Target Volume Contouring in Radiation Oncology

2023-11-03 · Yujin Oh, Sangjoon Park, Hwa Kyung Byun, Yeona Cho 외

Target volume contouring for radiation therapy is considered significantly more challenging than the normal organ segmentation tasks as it necessitates the utilization of both image and text-based clinical information. I…

Organ Segmentation