Efficient Deep Learning for Stereo Matching
In the past year, convolutional neural networks have been shown to perform extremely well for stereo estimation. However, current architectures rely on siamese networks which exploit concatenation followed by further processing layers, requiring a minute of GPU computation per image pair. In contrast, in this paper we propose a matching network which is able to produce very accurate results in less than a second of GPU computation. Towards this goal, we exploit a product layer which simply computes the inner product between the two representations of a siamese architecture. We train our network by treating the problem as multi-class classification, where the classes are all possible disparities. This allows us to get calibrated scores, which result in much better matching performance when compared to existing approaches.
Code (4)
Tasks
Deep LearningGeneral ClassificationGPUMulti-class ClassificationStereo MatchingStereo Matching HandSimilar Papers 제목 키워드 기반
Co-Teaching: An Ark to Unsupervised Stereo Matching
Stereo matching is a key component of autonomous driving perception. Recent unsupervised stereo matching approaches have received adequate attention due to their advantage of not requiring disparity ground truth. These a…
Autonomous DrivingStereo MatchingA novel stereo matching pipeline with robustness and unfixed disparity search range
Stereo matching is an essential basis for various applications, but most stereo matching methods have poor generalization performance and require a fixed disparity search range. Moreover, current stereo matching methods …
Stereo MatchingWHU-Stereo: A Challenging Benchmark for Stereo Matching of High-Resolution Satellite Images
Stereo matching of high-resolution satellite images (HRSI) is still a fundamental but challenging task in the field of photogrammetry and remote sensing. Recently, deep learning (DL) methods, especially convolutional neu…
Deep LearningStereo MatchingSCV-Stereo: Learning Stereo Matching from a Sparse Cost Volume
Convolutional neural network (CNN)-based stereo matching approaches generally require a dense cost volume (DCV) for disparity estimation. However, generating such cost volumes is computationally-intensive and memory-cons…
Disparity EstimationStereo MatchingSTEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching
Stereo matching is a fundamental task in 3D reconstruction. Despite remarkable advances, the prevailing paradigms formulate stereo matching as a deterministic regression problem, collapsing the multimodal distribution mo…
Zero-shot Generalization3D Reconstruction