paper-with-me

홈 › Papers

MS2DG-Net: Progressive Correspondence Learning via Multiple Sparse Semantics Dynamic Graph

2022-01-01 · CVPR 2022 1 · Luanyuan Dai, Yizhang Liu, Jiayi Ma, Lifang Wei, Taotao Lai, Changcai Yang, Riqing Chen

Establishing superior-quality correspondences in an image pair is pivotal to many subsequent computer vision tasks. Using Euclidean distance between correspondences to find neighbors and extract local information is a common strategy in previous works. However, most such works ignore similar sparse semantics information between two given images and cannot capture local topology among correspondences well. Therefore, to deal with the above problems, Multiple Sparse Semantics Dynamic Graph Network (MS^ 2 DG-Net) is proposed, in this paper, to predict probabilities of correspondences as inliers and recover camera poses. MS^ 2 DG-Net dynamically builds sparse semantics graphs based on sparse semantics similarity between two given images, to capture local topology among correspondences, while maintaining permutation-equivariant. Extensive experiments prove that MS^ 2 DG-Net outperforms state-of-the-art methods in outlier removal and camera pose estimation tasks on the public datasets with heavy outliers. Source code:https://github.com/changcaiyang/MS2DG-Net

📄 PDF Abstract BibTeX

Code (1)

changcaiyang/ms2dg-net 공식 구현

Tasks

Camera Pose EstimationPose Estimation

Methods 이 논문이 사용한 방법론

DG-Net 설명 없음

Similar Papers 제목 키워드 기반

S2LD: Sparse-to-Local-Dense Matching for Geometry-Guided Correspondence Estimation

2023-06-22 · IEEE Transactions on Image Processing 2023 6 · Shenghao Li, Qunfei Zhao, Zeyang Xia

Establishing reliable correspondences between two views is one of the most important components of various vision tasks. This paper proposes a novel sparse-to-local-dense (S2LD) matching method to conduct fully different…

Homography EstimationKeypoint detection and image matchingPose EstimationVisual Localization+1

Progressive Sparse Local Attention for Video object detection

2019-03-21 · ICCV 2019 10 · Chaoxu Guo, Bin Fan, Jie Gu, Qian Zhang 외

Transferring image-based object detectors to the domain of videos remains a challenging problem. Previous efforts mostly exploit optical flow to propagate features across frames, aiming to achieve a good trade-off betwee…

Objectobject-detectionObject DetectionOptical Flow Estimation+1

Progressive Correspondence Pruning by Consensus Learning

2021-01-03 · ICCV 2021 10 · Chen Zhao, Yixiao Ge, Feng Zhu, Rui Zhao 외

Correspondence selection aims to correctly select the consistent matches (inliers) from an initial set of putative correspondences. The selection is challenging since putative matches are typically extremely unbalanced, …

Camera Pose EstimationDenoisingPose EstimationRetrieval

Hierarchical Semantic Correspondence Networks for Video Paragraph Grounding

2023-01-01 · CVPR 2023 1 · Chaolei Tan, Zihang Lin, Jian-Fang Hu, Wei-Shi Zheng 외

Video Paragraph Grounding (VPG) is an essential yet challenging task in vision-language understanding, which aims to jointly localize multiple events from an untrimmed video with a paragraph query description. One of…

DecoderSentenceVideo Grounding

IMRAM: Iterative Matching with Recurrent Attention Memory for Cross-Modal Image-Text Retrieval

2020-03-08 · CVPR 2020 6 · Hui Chen, Guiguang Ding, Xudong Liu, Zijia Lin 외

Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a f…

Cross-Modal RetrievalImage-text RetrievalRetrievalText Retrieval