SKD: Keypoint Detection for Point Clouds using Saliency Estimation
We present SKD, a novel keypoint detector that uses saliency to determine the best candidates from a point cloud for tasks such as registration and reconstruction. The approach can be applied to any differentiable deep learning descriptor by using the gradients of that descriptor with respect to the 3D position of the input points as a measure of their saliency. The saliency is combined with the original descriptor and context information in a neural network, which is trained to learn robust keypoint candidates. The key intuition behind this approach is that keypoints are not extracted solely as a result of the geometry surrounding a point, but also take into account the descriptor's response. The approach was evaluated on two large LIDAR datasets - the Oxford RobotCar dataset and the KITTI dataset, where we obtain up to 50% improvement over the state-of-the-art in both matchability and repeatability. When performing sparse matching with the keypoints computed by our method we achieve a higher inlier ratio and faster convergence.
Code (0)
등록된 구현이 없습니다.
Tasks
Keypoint DetectionSaliency PredictionSimilar Papers 제목 키워드 기반
Centroid Distance Keypoint Detector for Colored Point Clouds
Keypoint detection serves as the basis for many computer vision and robotics applications. Despite the fact that colored point clouds can be readily obtained, most existing keypoint detectors extract only geometry-salien…
Computational EfficiencyKeypoint DetectionPoint Cloud RegistrationSNAKE: Shape-aware Neural 3D Keypoint Field
Detecting 3D keypoints from point clouds is important for shape reconstruction, while this work investigates the dual question: can shape reconstruction benefit 3D keypoint detection? Existing methods either seek salient…
Keypoint DetectionLearning a Descriptor-Specific 3D Keypoint Detector
Keypoint detection represents the first stage in the majority of modern computer vision pipelines based on automatically established correspondences between local descriptors. However, no standard solution has emerged ye…
Binary ClassificationKeypoint DetectionFrom Saliency to DINO: Saliency-guided Vision Transformer for Few-shot Keypoint Detection
Unlike current deep keypoint detectors that are trained to recognize limited number of body parts, few-shot keypoint detection (FSKD) attempts to localize any keypoints, including novel or base keypoints, depending on th…
Keypoint DetectionBoosting Object Recognition in Point Clouds by Saliency Detection
Object recognition in 3D point clouds is a challenging task, mainly when time is an important factor to deal with, such as in industrial applications. Local descriptors are an amenable choice whenever the 6 DoF pose of r…
Object RecognitionSaliency Detection