Generalized Differentiable RANSAC
We propose $\nabla$-RANSAC, a generalized differentiable RANSAC that allows learning the entire randomized robust estimation pipeline. The proposed approach enables the use of relaxation techniques for estimating the gradients in the sampling distribution, which are then propagated through a differentiable solver. The trainable quality function marginalizes over the scores from all the models estimated within $\nabla$-RANSAC to guide the network learning accurate and useful inlier probabilities or to train feature detection and matching networks. Our method directly maximizes the probability of drawing a good hypothesis, allowing us to learn better sampling distributions. We test $\nabla$-RANSAC on various real-world scenarios on fundamental and essential matrix estimation, and 3D point cloud registration, outdoors and indoors, with handcrafted and learning-based features. It is superior to the state-of-the-art in terms of accuracy while running at a similar speed to its less accurate alternatives. The code and trained models are available at https://github.com/weitong8591/differentiable_ransac.
Code (2)
Tasks
Point Cloud RegistrationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimation
Object pose estimation is a fundamental computer vision task exploited in several robotics and augmented reality applications. Many established approaches rely on predicting 2D-3D keypoint correspondences using RANSAC (R…
ObjectPose EstimationDSAC - Differentiable RANSAC for Camera Localization
RANSAC is an important algorithm in robust optimization and a central building block for many computer vision applications. In recent years, traditionally hand-crafted pipelines have been replaced by deep learning pipeli…
Camera LocalizationDeep LearningMedical Image SegmentationReinforcement Learning+1DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation
Monocular 6D pose estimation is a fundamental task in computer vision. Existing works often adopt a two-stage pipeline by establishing correspondences and utilizing a RANSAC algorithm to calculate 6 degrees-of-freedom (6…
6D Pose EstimationPose EstimationNeural-Guided RANSAC: Learning Where to Sample Model Hypotheses
We present Neural-Guided RANSAC (NG-RANSAC), an extension to the classic RANSAC algorithm from robust optimization. NG-RANSAC uses prior information to improve model hypothesis search, increasing the chance of finding ou…
Camera LocalizationHorizon Line EstimationVisual LocalizationGenDR: A Generalized Differentiable Renderer
In this work, we present and study a generalized family of differentiable renderers. We discuss from scratch which components are necessary for differentiable rendering and formalize the requirements for each component. …
3D Reconstruction