MS2DG-Net: Progressive Correspondence Learning via Multiple Sparse Semantics Dynamic Graph
Establishing superior-quality correspondences in an image pair is pivotal to many subsequent computer vision tasks. Using Euclidean distance between correspondences to find neighbors and extract local information is a common strategy in previous works. However, most such works ignore similar sparse semantics information between two given images and cannot capture local topology among correspondences well. Therefore, to deal with the above problems, Multiple Sparse Semantics Dynamic Graph Network (MS^ 2 DG-Net) is proposed, in this paper, to predict probabilities of correspondences as inliers and recover camera poses. MS^ 2 DG-Net dynamically builds sparse semantics graphs based on sparse semantics similarity between two given images, to capture local topology among correspondences, while maintaining permutation-equivariant. Extensive experiments prove that MS^ 2 DG-Net outperforms state-of-the-art methods in outlier removal and camera pose estimation tasks on the public datasets with heavy outliers. Source code:https://github.com/changcaiyang/MS2DG-Net
Code (1)
Tasks
Camera Pose EstimationPose EstimationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
S2LD: Sparse-to-Local-Dense Matching for Geometry-Guided Correspondence Estimation
Establishing reliable correspondences between two views is one of the most important components of various vision tasks. This paper proposes a novel sparse-to-local-dense (S2LD) matching method to conduct fully different…
Homography EstimationKeypoint detection and image matchingPose EstimationVisual Localization+1Progressive Sparse Local Attention for Video object detection
Transferring image-based object detectors to the domain of videos remains a challenging problem. Previous efforts mostly exploit optical flow to propagate features across frames, aiming to achieve a good trade-off betwee…
Objectobject-detectionObject DetectionOptical Flow Estimation+1Progressive Correspondence Pruning by Consensus Learning
Correspondence selection aims to correctly select the consistent matches (inliers) from an initial set of putative correspondences. The selection is challenging since putative matches are typically extremely unbalanced, …
Camera Pose EstimationDenoisingPose EstimationRetrievalHierarchical Semantic Correspondence Networks for Video Paragraph Grounding
Video Paragraph Grounding (VPG) is an essential yet challenging task in vision-language understanding, which aims to jointly localize multiple events from an untrimmed video with a paragraph query description. One of…
DecoderSentenceVideo GroundingIMRAM: Iterative Matching with Recurrent Attention Memory for Cross-Modal Image-Text Retrieval
Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a f…
Cross-Modal RetrievalImage-text RetrievalRetrievalText Retrieval