Stereo Superpixel Segmentation Via Decoupled Dynamic Spatial-Embedding Fusion Network
Stereo superpixel segmentation aims at grouping the discretizing pixels into perceptual regions through left and right views more collaboratively and efficiently. Existing superpixel segmentation algorithms mostly utilize color and spatial features as input, which may impose strong constraints on spatial information while utilizing the disparity information in terms of stereo image pairs. To alleviate this issue, we propose a stereo superpixel segmentation method with a decoupling mechanism of spatial information in this work. To decouple stereo disparity information and spatial information, the spatial information is temporarily removed before fusing the features of stereo image pairs, and a decoupled stereo fusion module (DSFM) is proposed to handle the stereo features alignment as well as occlusion problems. Moreover, since the spatial information is vital to superpixel segmentation, we further design a dynamic spatiality embedding module (DSEM) to re-add spatial information, and the weights of spatial information will be adaptively adjusted through the dynamic fusion (DF) mechanism in DSEM for achieving a finer segmentation. Comprehensive experimental results demonstrate that our method can achieve the state-of-the-art performance on the KITTI2015 and Cityscapes datasets, and also verify the efficiency when applied in salient object detection on NJU2K dataset. The source code will be available publicly after paper is accepted.
Code (0)
등록된 구현이 없습니다.
Tasks
object-detectionObject DetectionSalient Object DetectionSegmentationSimilar Papers 제목 키워드 기반
Generating Superpixels for High-resolution Images with Decoupled Patch Calibration
Superpixel segmentation has recently seen important progress benefiting from the advances in differentiable deep learning. However, the very high-resolution superpixel segmentation still remains challenging due to the ex…
GPUSegmentationSuperpixelsVocal Bursts Intensity PredictionStereo-based terrain traversability analysis using normal-based segmentation and superpixel surface analysis
In this paper, an stereo-based traversability analysis approach for all terrains in off-road mobile robotics, e.g. Unmanned Ground Vehicles (UGVs) is proposed. This approach reformulates the problem of terrain traversabi…
3D ReconstructionAllImage SegmentationSemantic SegmentationFuzzy Superpixel-based Image Segmentation
This article presents a multi-phase image segmentation methodology based on fuzzy superpixel decomposition, aggregation and merging. First, a collection of layers of dense fuzzy superpixels is generated by the variationa…
Image SegmentationSegmentationSemantic SegmentationSuperpixelsSuperpixel Segmentation Based on Spatially Constrained Subspace Clustering
Superpixel segmentation aims at dividing the input image into some representative regions containing pixels with similar and consistent intrinsic properties, without any prior knowledge about the shape and size of each s…
ClusteringSegmentationSuperpixelsSuperpixel Segmentation with Fully Convolutional Networks
In computer vision, superpixels have been widely used as an effective way to reduce the number of image primitives for subsequent processing. But only a few attempts have been made to incorporate them into deep neural ne…
Disparity EstimationSegmentationStereo MatchingSuperpixels