Beyond Photometric Consistency: Gradient-based Dissimilarity for Improving Visual Odometry and Stereo Matching
Pose estimation and map building are central ingredients of autonomous robots and typically rely on the registration of sensor data. In this paper, we investigate a new metric for registering images that builds upon on the idea of the photometric error. Our approach combines a gradient orientation-based metric with a magnitude-dependent scaling term. We integrate both into stereo estimation as well as visual odometry systems and show clear benefits for typical disparity and direct image registration tasks when using our proposed metric. Our experimental evaluation indicats that our metric leads to more robust and more accurate estimates of the scene depth as well as camera trajectory. Thus, the metric improves camera pose estimation and in turn the mapping capabilities of mobile robots. We believe that a series of existing visual odometry and visual SLAM systems can benefit from the findings reported in this paper.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationImage RegistrationPose EstimationStereo MatchingVisual OdometrySimilar Papers 제목 키워드 기반
On the Global Photometric Alignment for Low-Level Vision
Supervised low-level vision models rely on pixel-wise losses against paired references, yet paired training sets exhibit per-pair photometric inconsistency, say, different image pairs demand different global brightness, …
BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
Recent advances in generative video models have significantly improved visual realism in video object removal, yet evaluation protocols still focus on masked region fidelity, treating removal as local inpainting. In real…
Photometric Mesh Optimization for Video-Aligned 3D Object Reconstruction
In this paper, we address the problem of 3D object mesh reconstruction from RGB videos. Our approach combines the best of multi-view geometric and data-driven methods for 3D reconstruction by optimizing object meshes for…
3D Object Reconstruction3D ReconstructionObjectObject Reconstruction+1A guide through a family of phylogenetic dissimilarity measures among sites
Ecological studies have now gone beyond measures of species turnover towards measures of phylogenetic and functional dissimilarity with a main objective: disentangling the processes that drive species distributions from …
DiversityCon-DSO: Learning Short-Horizon Consistency Priors for RGB-D Direct Sparse Odometry
Visual odometry (VO) is a fundamental component in robotics and augmented reality. RGB-D direct VO benefits from metric depth measurements, but it can degrade in challenging environments, where dynamic objects, occlusion…
Pose EstimationVisual Odometry