Semantic Stereo Matching With Pyramid Cost Volumes
The accuracy of stereo matching has been greatly improved by using deep learning with convolutional neural networks. To further capture the details of disparity maps, in this paper, we propose a novel semantic stereo network named SSPCV-Net, which includes newly designed pyramid cost volumes for describing semantic and spatial information on multiple levels. The semantic features are inferred by a semantic segmentation subnetwork while the spatial features are derived by hierarchical spatial pooling. In the end, we design a 3D multi-cost aggregation module to integrate the extracted multilevel features and perform regression for accurate disparity maps. We conduct comprehensive experiments and comparisons with some recent stereo matching networks on Scene Flow, KITTI 2015 and 2012, and Cityscapes benchmark datasets, and the results show that the proposed SSPCV-Net significantly promotes the state-of-the-art stereo-matching performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Semantic SegmentationStereo MatchingSimilar Papers 제목 키워드 기반
Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching
The deep multi-view stereo (MVS) and stereo matching approaches generally construct 3D cost volumes to regularize and regress the output depth or disparity. These methods are limited when high-resolution outputs are need…
3D ReconstructionGPUPoint CloudsStereo MatchingPCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matching
Existing deep learning based stereo matching methods either focus on achieving optimal performances on the target dataset while with poor generalization for other datasets or focus on handling the cross-domain generaliza…
Disparity EstimationDomain GeneralizationStereo MatchingPVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matching
Supervised learning with deep convolutional neural networks (DCNNs) has seen huge adoption in stereo matching. However, the acquisition of large-scale datasets with well-labeled ground truth is cumbersome and labor-inten…
Stereo MatchingThese Maps Are Made by Propagation: Adapting Deep Stereo Networks to Road Scenarios with Decisive Disparity Diffusion
Stereo matching has emerged as a cost-effective solution for road surface 3D reconstruction, garnering significant attention towards improving both computational efficiency and accuracy. This article introduces decisive …
3D ReconstructionComputational EfficiencyStereo MatchingMulti-scale Cross-form Pyramid Network for Stereo Matching
Stereo matching plays an indispensable part in autonomous driving, robotics and 3D scene reconstruction. We propose a novel deep learning architecture, which called CFP-Net, a Cross-Form Pyramid stereo matching network f…
3D Feature Matching3D Scene ReconstructionAutonomous DrivingForm+2