Reassessing the Limitations of CNN Methods for Camera Pose Regression
In this paper, we address the problem of camera pose estimation in outdoor and indoor scenarios. In comparison to the currently top-performing methods that rely on 2D to 3D matching, we propose a model that can directly regress the camera pose from images with significantly higher accuracy than existing methods of the same class. We first analyse why regression methods are still behind the state-of-the-art, and we bridge the performance gap with our new approach. Specifically, we propose a way to overcome the biased training data by a novel training technique, which generates poses guided by a probability distribution from the training set for synthesising new training views. Lastly, we evaluate our approach on two widely used benchmarks and show that it achieves significantly improved performance compared to prior regression-based methods, retrieval techniques as well as 3D pipelines with local feature matching.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationPose EstimationregressionRetrievalSimilar Papers 제목 키워드 기반
Understanding the Limitations of CNN-based Absolute Camera Pose Regression
Visual localization is the task of accurate camera pose estimation in a known scene. It is a key problem in computer vision and robotics, with applications including self-driving cars, Structure-from-Motion, SLAM, and Mi…
3D geometryCamera Pose EstimationImage RetrievalMixed Reality+5A Decade of Automatic Content Evaluation of News Summaries: Reassessing the State of the Art
Reassessing Graph Linearization for Sequence-to-sequence AMR Parsing: On the Advantages and Limitations of Triple-Based Encoding
Sequence-to-sequence models are widely used to train Abstract Meaning Representation (Banarescu et al., 2013, AMR) parsers. To train such models, AMR graphs have to be linearized into a one-line text format. While Penman…
Abstract Meaning RepresentationAMR ParsingLENS: Localization enhanced by NeRF synthesis
Neural Radiance Fields (NeRF) have recently demonstrated photo-realistic results for the task of novel view synthesis. In this paper, we propose to apply novel view synthesis to the robot relocalization problem: we demon…
3D geometryData AugmentationDomain AdaptationNeRF+2Wide-Baseline Relative Camera Pose Estimation with Directional Learning
Modern deep learning techniques that regress the relative camera pose between two images have difficulty dealing with challenging scenarios, such as large camera motions resulting in occlusions and significant changes in…
Camera Pose EstimationPose Estimationregression