Learning Superpixels With Segmentation-Aware Affinity Loss
Superpixel segmentation has been widely used in many computer vision tasks. Existing superpixel algorithms are mainly based on hand-crafted features, which often fail to preserve weak object boundaries. In this work, we leverage deep neural networks to facilitate extracting superpixels from images. We show a simple integration of deep features with existing superpixel algorithms does not result in better performance as these features do not model segmentation. Instead, we propose a segmentation-aware affinity learning approach for superpixel segmentation. Specifically, we propose a new loss function that takes the segmentation error into account for affinity learning. We also develop the Pixel Affinity Net for affinity prediction. Extensive experimental results show that the proposed algorithm based on the learned segmentation-aware loss performs favorably against the state-of-the-art methods. We also demonstrate the use of the learned superpixels in numerous vision applications with consistent improvements.
Code (0)
등록된 구현이 없습니다.
Tasks
SegmentationSuperpixelsSimilar Papers 제목 키워드 기반
Segmentation-Aware Hyperspectral Image Classification
In this paper, we propose an unified hyperspectral image classification method which takes three-dimensional hyperspectral data cube as an input and produces a classification map. In the proposed method, a deep neural ne…
ClassificationGeneral ClassificationHyperspectral Image Classificationimage-classification+3Adaptive Fusion Affinity Graph with Noise-free Online Low-rank Representation for Natural Image Segmentation
Affinity graph-based segmentation methods have become a major trend in computer vision. The performance of these methods relies on the constructed affinity graph, with particular emphasis on the neighborhood topology and…
Density EstimationImage SegmentationSemantic SegmentationSuperpixelsAffinity Fusion Graph-based Framework for Natural Image Segmentation
This paper proposes an affinity fusion graph framework to effectively connect different graphs with highly discriminating power and nonlinearity for natural image segmentation. The proposed framework combines adjacency-g…
ClusteringImage SegmentationSegmentationSemantic Segmentation+1HERS Superpixels: Deep Affinity Learning for Hierarchical Entropy Rate Segmentation
Superpixels serve as a powerful preprocessing tool in numerous computer vision tasks. By using superpixel representation, the number of image primitives can be largely reduced by orders of magnitudes. With the rise of de…
SuperpixelsRe-purposing SAM into Efficient Visual Projectors for MLLM-Based Referring Image Segmentation
Recently, Referring Image Segmentation (RIS) frameworks that pair the Multimodal Large Language Model (MLLM) with the Segment Anything Model (SAM) have achieved impressive results. However, adapting MLLM to segmentation …
Image Segmentation