Learning Correspondence Uncertainty via Differentiable Nonlinear Least Squares
We propose a differentiable nonlinear least squares framework to account for uncertainty in relative pose estimation from feature correspondences. Specifically, we introduce a symmetric version of the probabilistic normal epipolar constraint, and an approach to estimate the covariance of feature positions by differentiating through the camera pose estimation procedure. We evaluate our approach on synthetic, as well as the KITTI and EuRoC real-world datasets. On the synthetic dataset, we confirm that our learned covariances accurately approximate the true noise distribution. In real world experiments, we find that our approach consistently outperforms state-of-the-art non-probabilistic and probabilistic approaches, regardless of the feature extraction algorithm of choice.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationPose EstimationSimilar Papers 제목 키워드 기반
Differentiable Rendering for Pose Estimation in Proximity Operations
Differentiable rendering aims to compute the derivative of the image rendering function with respect to the rendering parameters. This paper presents a novel algorithm for 6-DoF pose estimation through gradient-based opt…
Pose EstimationScalable and Differentiable Point-Cloud Registration Using Maximum Mean Discrepancy
We present MMD-Reg, a novel correspondence-free approach to point-cloud registration that is differentiable and has linear computational complexity in the number of points. We model registration as a nonlinear least-squa…
Training Recurrent Neural Networks by Sequential Least Squares and the Alternating Direction Method of Multipliers
This paper proposes a novel algorithm for training recurrent neural network models of nonlinear dynamical systems from an input/output training dataset. Arbitrary convex and twice-differentiable loss functions and regula…
Planar Object Tracking via Weighted Optical Flow
We propose WOFT -- a novel method for planar object tracking that estimates a full 8 degrees-of-freedom pose, i.e. the homography w.r.t. a reference view. The method uses a novel module that leverages dense optical flow …
ObjectObject TrackingOptical Flow EstimationBayesian System ID: Optimal management of parameter, model, and measurement uncertainty
We evaluate the robustness of a probabilistic formulation of system identification (ID) to sparse, noisy, and indirect data. Specifically, we compare estimators of future system behavior derived from the Bayesian posteri…
AttributeManagement