Semantic Instance Segmentation with a Discriminative Loss Function
Semantic instance segmentation remains a challenging task. In this work we propose to tackle the problem with a discriminative loss function, operating at the pixel level, that encourages a convolutional network to produce a representation of the image that can easily be clustered into instances with a simple post-processing step. The loss function encourages the network to map each pixel to a point in feature space so that pixels belonging to the same instance lie close together while different instances are separated by a wide margin. Our approach of combining an off-the-shelf network with a principled loss function inspired by a metric learning objective is conceptually simple and distinct from recent efforts in instance segmentation. In contrast to previous works, our method does not rely on object proposals or recurrent mechanisms. A key contribution of our work is to demonstrate that such a simple setup without bells and whistles is effective and can perform on par with more complex methods. Moreover, we show that it does not suffer from some of the limitations of the popular detect-and-segment approaches. We achieve competitive performance on the Cityscapes and CVPPP leaf segmentation benchmarks.
Code (8)
Tasks
Instance SegmentationLane DetectionMetric LearningMulti-Human ParsingSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
3D Graph Embedding Learning with a Structure-aware Loss Function for Point Cloud Semantic Instance Segmentation
This paper introduces a novel approach for 3D semantic instance segmentation on point clouds. A 3D convolutional neural network called submanifold sparse convolutional network is used to generate semantic predictions and…
3D Instance Segmentation3D Semantic Instance SegmentationGraph EmbeddingInstance Segmentation+1blob loss: instance imbalance aware loss functions for semantic segmentation
Deep convolutional neural networks (CNN) have proven to be remarkably effective in semantic segmentation tasks. Most popular loss functions were introduced targeting improved volumetric scores, such as the Dice coefficie…
3D Semantic SegmentationSegmentationSemantic SegmentationCFNet: Learning Correlation Functions for One-Stage Panoptic Segmentation
Recently, there is growing attention on one-stage panoptic segmentation methods which aim to segment instances and stuff jointly within a fully convolutional pipeline efficiently. However, most of the existing works dire…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationELKPPNet: An Edge-aware Neural Network with Large Kernel Pyramid Pooling for Learning Discriminative Features in Semantic Segmentation
Semantic segmentation has been a hot topic across diverse research fields. Along with the success of deep convolutional neural networks, semantic segmentation has made great achievements and improvements, in terms of bot…
DecoderScene ParsingSegmentationSemantic SegmentationHierarchical Lovász Embeddings for Proposal-free Panoptic Segmentation
Panoptic segmentation brings together two separate tasks: instance and semantic segmentation. Although they are related, unifying them faces an apparent paradox: how to learn simultaneously instance-specific and category…
Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation