A Novel Factor Graph-Based Optimization Technique for Stereo Correspondence Estimation
Dense disparities among multiple views is essential for estimating the 3D architecture of a scene based on the geometrical relationship among the scene and the views or cameras. Scenes with larger extents of heterogeneous textures, differing scene illumination among the multiple views and with occluding objects affect the accuracy of the estimated disparities. Markov random fields (MRF) based methods for disparity estimation address these limitations using spatial dependencies among the observations and among the disparity estimates. These methods, however, are limited by spatially fixed and smaller neighborhood systems or cliques. In this work, we present a new factor graph-based probabilistic graphical model for disparity estimation that allows a larger and a spatially variable neighborhood structure determined based on the local scene characteristics. We evaluated our method using the Middlebury benchmark stereo datasets and the Middlebury evaluation dataset version 3.0 and compared its performance with recent state-of-the-art disparity estimation algorithms. The new factor graph-based method provided disparity estimates with higher accuracy when compared to the recent non-learning- and learning-based disparity estimation algorithms. In addition to disparity estimation, our factor graph formulation can be useful for obtaining maximum a posteriori solution to optimization problems with complex and variable dependency structures as well as for other dense estimation problems such as optical flow estimation.
Code (0)
등록된 구현이 없습니다.
Tasks
3D ArchitectureDisparity EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Multi-Resolution Factor Graph Based Stereo Correspondence Algorithm
A dense depth-map of a scene at an arbitrary view orientation can be estimated from dense view correspondences among multiple lower-dimensional views of the scene. These low-dimensional view correspondences are dependent…
Stereo MatchingKeypoint-based Stereophotoclinometry for Characterizing and Navigating Small Bodies: A Factor Graph Approach
This paper proposes the incorporation of techniques from stereophotoclinometry (SPC) into a keypoint-based structure-from-motion (SfM) system to estimate the surface normal and albedo at detected landmarks to improve aut…
Keypoint DetectionPose EstimationParallax Attention for Unsupervised Stereo Correspondence Learning
Stereo image pairs encode 3D scene cues into stereo correspondences between the left and right images. To exploit 3D cues within stereo images, recent CNN based methods commonly use cost volume techniques to capture ster…
Image Super-ResolutionStereo Image Super-ResolutionStereo MatchingSuper-ResolutionStereophotoclinometry Revisited
Image-based surface reconstruction and characterization is crucial for missions to small celestial bodies, as it informs mission planning, navigation, and scientific analysis. However, current state-of-the-practice metho…
Keypoint DetectionSurface ReconstructionRectification-specific Supervision and Constrained Estimator for Online Stereo Rectification
Online stereo rectification is critical for autonomous vehicles and robots in dynamic environments, where factors such as vibration, temperature fluctuations, and mechanical stress can affect rectification accuracy a…
Autonomous VehiclesDepth EstimationOptical Flow EstimationStereo Depth Estimation