MC-Stereo: Multi-peak Lookup and Cascade Search Range for Stereo Matching
Stereo matching is a fundamental task in scene comprehension. In recent years, the method based on iterative optimization has shown promise in stereo matching. However, the current iteration framework employs a single-peak lookup, which struggles to handle the multi-peak problem effectively. Additionally, the fixed search range used during the iteration process limits the final convergence effects. To address these issues, we present a novel iterative optimization architecture called MC-Stereo. This architecture mitigates the multi-peak distribution problem in matching through the multi-peak lookup strategy, and integrates the coarse-to-fine concept into the iterative framework via the cascade search range. Furthermore, given that feature representation learning is crucial for successful learn-based stereo matching, we introduce a pre-trained network to serve as the feature extractor, enhancing the front end of the stereo matching pipeline. Based on these improvements, MC-Stereo ranks first among all publicly available methods on the KITTI-2012 and KITTI-2015 benchmarks, and also achieves state-of-the-art performance on ETH3D. Code is available at https://github.com/MiaoJieF/MC-Stereo.
Code (1)
Tasks
Representation LearningStereo MatchingSimilar Papers 제목 키워드 기반
Cascade hash tables: a series of multilevel double hashing schemes with O(1) worst case lookup time
In this paper, the author proposes a series of multilevel double hashing schemes called cascade hash tables. They use several levels of hash tables. In each table, we use the common double hashing scheme. Higher level ha…
Learning Series-Parallel Lookup Tables for Efficient Image Super-Resolution
Lookup table (LUT) has shown its efficacy in low-level vision tasks due to the valuable characteristics of low computational cost and hardware independence. However, recent attempts to address the problem of single image…
Image Super-ResolutionSuper-ResolutionFFCA-Net: Stereo Image Compression via Fast Cascade Alignment of Side Information
Multi-view compression technology, especially Stereo Image Compression (SIC), plays a crucial role in car-mounted cameras and 3D-related applications. Interestingly, the Distributed Source Coding (DSC) theory suggests th…
Data CompressionDecoderImage CompressionPatch MatchingCFNet: Cascade and Fused Cost Volume for Robust Stereo Matching
Recently, the ever-increasing capacity of large-scale annotated datasets has led to profound progress in stereo matching. However, most of these successes are limited to a specific dataset and cannot generalize well to o…
Disparity EstimationStereo MatchingEdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matching
Recent convolutional neural networks, especially end-to-end disparity estimation models, achieve remarkable performance on stereo matching task. However, existed methods, even with the complicated cascade structure, may …
Disparity EstimationEdge DetectionStereo MatchingStereo Matching Hand