paper-with-me

홈 › Papers

D3Former: Jointly Learning Repeatable Dense Detectors and Feature-enhanced Descriptors via Saliency-guided Transformer

2023-12-20 · Junjie Gao, Pengfei Wang, Qiujie Dong, Qiong Zeng, Shiqing Xin, Caiming Zhang

Establishing accurate and representative matches is a crucial step in addressing the point cloud registration problem. A commonly employed approach involves detecting keypoints with salient geometric features and subsequently mapping these keypoints from one frame of the point cloud to another. However, methods within this category are hampered by the repeatability of the sampled keypoints. In this paper, we introduce a saliency-guided trans\textbf{former}, referred to as \textit{D3Former}, which entails the joint learning of repeatable \textbf{D}ense \textbf{D}etectors and feature-enhanced \textbf{D}escriptors. The model comprises a Feature Enhancement Descriptor Learning (FEDL) module and a Repetitive Keypoints Detector Learning (RKDL) module. The FEDL module utilizes a region attention mechanism to enhance feature distinctiveness, while the RKDL module focuses on detecting repeatable keypoints to enhance matching capabilities. Extensive experimental results on challenging indoor and outdoor benchmarks demonstrate that our proposed method consistently outperforms state-of-the-art point cloud matching methods. Notably, tests on 3DLoMatch, even with a low overlap ratio, show that our method consistently outperforms recently published approaches such as RoReg and RoITr. For instance, with the number of extracted keypoints reduced to 250, the registration recall scores for RoReg, RoITr, and our method are 64.3\%, 73.6\%, and 76.5\%, respectively.

📄 PDF Abstract BibTeX arXiv:2312.12970

Code (0)

등록된 구현이 없습니다.

Tasks

Point Cloud Registration

Similar Papers 제목 키워드 기반

LoFTR: Detector-Free Local Feature Matching with Transformers

2021-04-01 · CVPR 2021 1 · Jiaming Sun, Zehong Shen, Yuang Wang, Hujun Bao 외

We present a novel method for local image feature matching. Instead of performing image feature detection, description, and matching sequentially, we propose to first establish pixel-wise dense matches at a coarse level …

Camera Pose EstimationImage MatchingPose EstimationVisual Localization

R2D2: Reliable and Repeatable Detector and Descriptor

2019-12-01 · NeurIPS 2019 12 · Jerome Revaud, Cesar De Souza, Martin Humenberger, Philippe Weinzaepfel

Interest point detection and local feature description are fundamental steps in many computer vision applications. Classical approaches are based on a detect-then-describe paradigm where separate handcrafted methods are …

Atari GamesCamera LocalizationImage MatchingInterest Point Detection+2

R2D2: Repeatable and Reliable Detector and Descriptor

2019-06-14 · Jerome Revaud, Philippe Weinzaepfel, César De Souza, Noe Pion 외

Interest point detection and local feature description are fundamental steps in many computer vision applications. Classical methods for these tasks are based on a detect-then-describe paradigm where separate handcrafted…

Interest Point DetectionKeypoint DetectionMetric Learning

GLAMpoints: Greedily Learned Accurate Match points

2019-08-19 · ICCV 2019 10 · Prune Truong, Stefanos Apostolopoulos, Agata Mosinska, Samuel Stucky 외

We introduce a novel CNN-based feature point detector - GLAMpoints - learned in a semi-supervised manner. Our detector extracts repeatable, stable interest points with a dense coverage, specifically designed to maximize …

Image RegistrationKeypoint Detection

Training Deep Neural Networks to Detect Repeatable 2D Features Using Large Amounts of 3D World Capture Data

2019-12-09 · Alexander Mai, Joseph Menke, Allen Yang

Image space feature detection is the act of selecting points or parts of an image that are easy to distinguish from the surrounding image region. By combining a repeatable point detection with a descriptor, parts of an i…