Hierarchical Superpixel Segmentation via Structural Information Theory
Superpixel segmentation is a foundation for many higher-level computer vision tasks, such as image segmentation, object recognition, and scene understanding. Existing graph-based superpixel segmentation methods typically concentrate on the relationships between a given pixel and its directly adjacent pixels while overlooking the influence of non-adjacent pixels. These approaches do not fully leverage the global information in the graph, leading to suboptimal segmentation quality. To address this limitation, we present SIT-HSS, a hierarchical superpixel segmentation method based on structural information theory. Specifically, we first design a novel graph construction strategy that incrementally explores the pixel neighborhood to add edges based on 1-dimensional structural entropy (1D SE). This strategy maximizes the retention of graph information while avoiding an overly complex graph structure. Then, we design a new 2D SE-guided hierarchical graph partitioning method, which iteratively merges pixel clusters layer by layer to reduce the graph's 2D SE until a predefined segmentation scale is achieved. Experimental results on three benchmark datasets demonstrate that the SIT-HSS performs better than state-of-the-art unsupervised superpixel segmentation algorithms. The source code is available at \url{https://github.com/SELGroup/SIT-HSS}.
Code (1)
Tasks
graph constructiongraph partitioningImage SegmentationObject RecognitionScene UnderstandingSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
HERS Superpixels: Deep Affinity Learning for Hierarchical Entropy Rate Segmentation
Superpixels serve as a powerful preprocessing tool in numerous computer vision tasks. By using superpixel representation, the number of image primitives can be largely reduced by orders of magnitudes. With the rise of de…
SuperpixelsHierarchical Piecewise-Constant Super-regions
Recent applications in computer vision have come to heavily rely on superpixel over-segmentation as a pre-processing step for higher level vision tasks, such as object recognition, image labelling or image segmentation. …
DenoisingFormImage SegmentationObject Recognition+3Hierarchical Homogeneity-Based Superpixel Segmentation: Application to Hyperspectral Image Analysis
Hyperspectral image (HI) analysis approaches have recently become increasingly complex and sophisticated. Recently, the combination of spectral-spatial information and superpixel techniques have addressed some hyperspect…
Hyperspectral image analysisSuperpixelsImplicit Integration of Superpixel Segmentation into Fully Convolutional Networks
Superpixels are a useful representation to reduce the complexity of image data. However, to combine superpixels with convolutional neural networks (CNNs) in an end-to-end fashion, one requires extra models to generate su…
Depth EstimationMonocular Depth EstimationSegmentationSemantic Segmentation+1Superpixel Pre-Segmentation of HER2 Slides for Efficient Annotation
Supervised deep learning has shown state-of-the-art performance for medical image segmentation across different applications, including histopathology and cancer research; however, the manual annotation of such data is e…
ClusteringDenoisingImage SegmentationMedical Image Segmentation+3