Beyond outlier removal: Integrated ensemble matching for accurate image keypoint correspondence
This paper presents a novel two-tier matching approach for robust feature correspondence and geometric transformation estimation in computer vision tasks. Our method combines sub-descriptor matching and multi-descriptor ensembling to significantly improve the accuracy and reliability of keypoint correspondences across images. Our approach is evaluated on both classic hand-crafted algorithms and deep learning-based methods using the HPatches, IMC2022, and YFCC100M datasets. We use a pretrained network and enhance it to incorporate additional descriptor heads optimized for our matching strategy. The two-tier matching strategy enables direct geometric transformation estimation without separate outlier removal in many cases, potentially streamlining computer vision pipelines. Results demonstrate that our approach substantially outperforms traditional single-descriptor methods, achieving over 95% correct matches for classic algorithm combinations and up to 96% for our enhanced learning-based approaches. Our approach can establish reliable correspondences without making any assumption about the mathematical relation between the matches. Additionally, we explore applications of our method in scene matching.
Code (1)
Similar Papers 제목 키워드 기반
SSORN: Self-Supervised Outlier Removal Network for Robust Homography Estimation
The traditional homography estimation pipeline consists of four main steps: feature detection, feature matching, outlier removal and transformation estimation. Recent deep learning models intend to address the homography…
Deep LearningDenoisingHomography EstimationEfficient Outlier Removal in Large Scale Global Structure-from-Motion
This work addresses the outlier removal problem in large-scale global structure-from-motion. In such applications, global outlier removal is very useful to mitigate the deterioration caused by mismatches in the feature p…
Dimensionality ReductionProgressive Correspondence Regenerator for Robust 3D Registration
Obtaining enough high-quality correspondences is crucial for robust registration. Existing correspondence refinement methods mostly follow the paradigm of outlier removal, which either fails to correctly identify the acc…
A New Outlier Removal Strategy Based on Reliability of Correspondence Graph for Fast Point Cloud Registration
Registration is a basic yet crucial task in point cloud processing. In correspondence-based point cloud registration, matching correspondences by point feature techniques may lead to an extremely high outlier ratio. Curr…
Point Cloud RegistrationPractical Robust Two-View Translation Estimation
Outliers pose a problem in all real structure from motion systems. Due to the use of automatic matching methods one has to expect that a (sometimes very large) portion of the detected correspondences can be incorrect. In…
TranslationVocal Bursts Valence Prediction