An Efficient Solution to Non-Minimal Case Essential Matrix Estimation
Finding relative pose between two calibrated images is a fundamental task in computer vision. Given five point correspondences, the classical five-point methods can be used to calculate the essential matrix efficiently. For the case of $N$ ($N > 5$) inlier point correspondences, which is called $N$-point problem, existing methods are either inefficient or prone to local minima. In this paper, we propose a certifiably globally optimal and efficient solver for the $N$-point problem. First we formulate the problem as a quadratically constrained quadratic program (QCQP). Then a certifiably globally optimal solution to this problem is obtained by semidefinite relaxation. This allows us to obtain certifiably globally optimal solutions to the original non-convex QCQPs in polynomial time. The theoretical guarantees of the semidefinite relaxation are also provided, including tightness and local stability. To deal with outliers, we propose a robust $N$-point method using M-estimators. Though global optimality cannot be guaranteed for the overall robust framework, the proposed robust $N$-point method can achieve good performance when the outlier ratio is not high. Extensive experiments on synthetic and real-world datasets demonstrated that our $N$-point method is $2\sim3$ orders of magnitude faster than state-of-the-art methods. Moreover, our robust $N$-point method outperforms state-of-the-art methods in terms of robustness and accuracy.
Code (2)
Similar Papers 제목 키워드 기반
Essential Matrix Estimation using Convex Relaxations in Orthogonal Space
We introduce a novel method to estimate the essential matrix for two-view Structure from Motion (SfM). We show that every 3 by 3 essential matrix can be embedded in a 4 by 4 rotation, having its bottom right entry fi…
Minimal Solvers for Relative Pose with a Single Unknown Radial Distortion
In this paper, we study the problems of estimating relative pose between two cameras in the presence of radial distortion. Specifically, we consider minimal problems where one of the cameras has no or known radial disto…
A Certifiably Globally Optimal Solution to Generalized Essential Matrix Estimation
We present a convex optimization approach for generalized essential matrix (GEM) estimation. The six-point minimal solver for the GEM has poor numerical stability and applies only for a minimal number of points. Existing…
Motion Estimation for Self-Driving Cars with a Generalized Camera
In this paper, we present a visual ego-motion estimation algorithm for a self-driving car equipped with a closeto-market multi-camera system. By modeling the multicamera system as a generalized camera and applying the no…
Motion EstimationSelf-Driving CarsOn the Minimal Problems of Low-Rank Matrix Factorization
Low-rank matrix factorization is an essential problem in many areas including computer vision, with applications in e.g. affine structure-from-motion, photometric stereo, and non-rigid structure from motion. However, ve…