Separable Convolutions for Optimizing 3D Stereo Networks
Deep learning based 3D stereo networks give superior performance compared to 2D networks and conventional stereo methods. However, this improvement in the performance comes at the cost of increased computational complexity, thus making these networks non-practical for the real-world applications. Specifically, these networks use 3D convolutions as a major work horse to refine and regress disparities. In this work first, we show that these 3D convolutions in stereo networks consume up to 94% of overall network operations and act as a major bottleneck. Next, we propose a set of "plug-&-run" separable convolutions to reduce the number of parameters and operations. When integrated with the existing state of the art stereo networks, these convolutions lead up to 7x reduction in number of operations and up to 3.5x reduction in parameters without compromising their performance. In fact these convolutions lead to improvement in their performance in the majority of cases.
Code (1)
Similar Papers 제목 키워드 기반
AMNet: Deep Atrous Multiscale Stereo Disparity Estimation Networks
In this paper, a new deep learning architecture for stereo disparity estimation is proposed. The proposed atrous multiscale network (AMNet) adopts an efficient feature extractor with depthwise-separable convolutions and …
Disparity EstimationStereo Disparity EstimationStereo MatchingStereo Matching HandTowards a New Interpretation of Separable Convolutions
In recent times, the use of separable convolutions in deep convolutional neural network architectures has been explored. Several researchers, most notably (Chollet, 2016) and (Ghosh, 2017) have used separable convolution…
Network Decoupling: From Regular to Depthwise Separable Convolutions
Depthwise separable convolution has shown great efficiency in network design, but requires time-consuming training procedure with full training-set available. This paper first analyzes the mathematical relationship betwe…
object-detectionObject DetectionLeveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo
The problem of estimating a surface shape from its observed reflectance properties still remains a challenging task in computer vision. The presence of global illumination effects such as inter-reflections or cast shadow…
MABNet: A Lightweight Stereo Network Based on Multibranch Adjustable Bottleneck Module
Recently, end-to-end CNNs have presented remarkable performance for disparity estimation. But most of them are too heavy to resource-constrained devices, because of enormous parameters necessary for satisfactory results.…
Disparity Estimation