ORStereo: Occlusion-Aware Recurrent Stereo Matching for 4K-Resolution Images
Stereo reconstruction models trained on small images do not generalize well to high-resolution data. Training a model on high-resolution image size faces difficulties of data availability and is often infeasible due to limited computing resources. In this work, we present the Occlusion-aware Recurrent binocular Stereo matching (ORStereo), which deals with these issues by only training on available low disparity range stereo images. ORStereo generalizes to unseen high-resolution images with large disparity ranges by formulating the task as residual updates and refinements of an initial prediction. ORStereo is trained on images with disparity ranges limited to 256 pixels, yet it can operate 4K-resolution input with over 1000 disparities using limited GPU memory. We test the model's capability on both synthetic and real-world high-resolution images. Experimental results demonstrate that ORStereo achieves comparable performance on 4K-resolution images compared to state-of-the-art methods trained on large disparity ranges. Compared to other methods that are only trained on low-resolution images, our method is 70% more accurate on 4K-resolution images.
Code (0)
등록된 구현이 없습니다.
Tasks
4kGPUStereo MatchingSimilar Papers 제목 키워드 기반
Geometry-based Occlusion-Aware Unsupervised Stereo Matching for Autonomous Driving
Recently, there are emerging many stereo matching methods for autonomous driving based on unsupervised learning. Most of them take advantage of reconstruction losses to remove dependency on disparity groundtruth. Occlusi…
Autonomous DrivingOcclusion HandlingStereo MatchingGlobal Occlusion-Aware Transformer for Robust Stereo Matching
Despite the remarkable progress facilitated by learning-based stereo-matching algorithms, the performance in the ill-conditioned regions, such as the occluded regions, remains a bottleneck. Due to the limited receptive f…
Disparity EstimationOcclusion EstimationStereo MatchingDEFOM-Stereo: Depth Foundation Model Based Stereo Matching
Stereo matching is a key technique for metric depth estimation in computer vision and robotics. Real-world challenges like occlusion and non-texture hinder accurate disparity estimation from binocular matching cues. Rece…
Depth EstimationDisparity EstimationmodelStereo Matching+1Revealing the Reciprocal Relations Between Self-Supervised Stereo and Monocular Depth Estimation
Current self-supervised depth estimation algorithms mainly focus on either stereo or monocular only, neglecting the reciprocal relations between them. In this paper, we propose a simple yet effective framework to imp…
Depth EstimationMonocular Depth EstimationStereo MatchingA Decomposition Model for Stereo Matching
In this paper, we present a decomposition model for stereo matching to solve the problem of excessive growth in computational cost (time and memory cost) as the resolution increases. In order to reduce the huge cost of s…
Disparity EstimationmodelStereo Matching