HERS Superpixels: Deep Affinity Learning for Hierarchical Entropy Rate Segmentation
Superpixels serve as a powerful preprocessing tool in numerous computer vision tasks. By using superpixel representation, the number of image primitives can be largely reduced by orders of magnitudes. With the rise of deep learning in recent years, a few works have attempted to feed deeply learned features / graphs into existing classical superpixel techniques. However, none of them are able to produce superpixels in near real-time, which is crucial to the applicability of superpixels in practice. In this work, we propose a two-stage graph-based framework for superpixel segmentation. In the first stage, we introduce an efficient Deep Affinity Learning (DAL) network that learns pairwise pixel affinities by aggregating multi-scale information. In the second stage, we propose a highly efficient superpixel method called Hierarchical Entropy Rate Segmentation (HERS). Using the learned affinities from the first stage, HERS builds a hierarchical tree structure that can produce any number of highly adaptive superpixels instantaneously. We demonstrate, through visual and numerical experiments, the effectiveness and efficiency of our method compared to various state-of-the-art superpixel methods.
Code (1)
Tasks
SuperpixelsSimilar Papers 제목 키워드 기반
Learning Superpixels With Segmentation-Aware Affinity Loss
Superpixel segmentation has been widely used in many computer vision tasks. Existing superpixel algorithms are mainly based on hand-crafted features, which often fail to preserve weak object boundaries. In this work, we …
SegmentationSuperpixelsAdaptive Fusion Affinity Graph with Noise-free Online Low-rank Representation for Natural Image Segmentation
Affinity graph-based segmentation methods have become a major trend in computer vision. The performance of these methods relies on the constructed affinity graph, with particular emphasis on the neighborhood topology and…
Density EstimationImage SegmentationSemantic SegmentationSuperpixelsAffinity Fusion Graph-based Framework for Natural Image Segmentation
This paper proposes an affinity fusion graph framework to effectively connect different graphs with highly discriminating power and nonlinearity for natural image segmentation. The proposed framework combines adjacency-g…
ClusteringImage SegmentationSegmentationSemantic Segmentation+1Segmentation-Aware Hyperspectral Image Classification
In this paper, we propose an unified hyperspectral image classification method which takes three-dimensional hyperspectral data cube as an input and produces a classification map. In the proposed method, a deep neural ne…
ClassificationGeneral ClassificationHyperspectral Image Classificationimage-classification+3Hierarchical Piecewise-Constant Super-regions
Recent applications in computer vision have come to heavily rely on superpixel over-segmentation as a pre-processing step for higher level vision tasks, such as object recognition, image labelling or image segmentation. …
DenoisingFormImage SegmentationObject Recognition+3