Generative Semantic Segmentation
We present Generative Semantic Segmentation (GSS), a generative learning approach for semantic segmentation. Uniquely, we cast semantic segmentation as an image-conditioned mask generation problem. This is achieved by replacing the conventional per-pixel discriminative learning with a latent prior learning process. Specifically, we model the variational posterior distribution of latent variables given the segmentation mask. To that end, the segmentation mask is expressed with a special type of image (dubbed as maskige). This posterior distribution allows to generate segmentation masks unconditionally. To achieve semantic segmentation on a given image, we further introduce a conditioning network. It is optimized by minimizing the divergence between the posterior distribution of maskige (i.e., segmentation masks) and the latent prior distribution of input training images. Extensive experiments on standard benchmarks show that our GSS can perform competitively to prior art alternatives in the standard semantic segmentation setting, whilst achieving a new state of the art in the more challenging cross-domain setting.
Code (2)
Tasks
SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Pixel Level Data Augmentation for Semantic Image Segmentation using Generative Adversarial Networks
Semantic segmentation is one of the basic topics in computer vision, it aims to assign semantic labels to every pixel of an image. Unbalanced semantic label distribution could have a negative influence on segmentation ac…
Data AugmentationImage SegmentationSegmentationSemantic SegmentationScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation
Recent advances in generative models, such as diffusion models, have made generating high-quality synthetic images widely accessible. Prior works have shown that training on synthetic images improves many perception task…
Data Augmentationimage-classificationImage Classificationobject-detection+3Conditional Generative Refinement Adversarial Networks for Unbalanced Medical Image Semantic Segmentation
We propose a new generative adversarial architecture to mitigate imbalance data problem in medical image semantic segmentation where the majority of pixels belongs to a healthy region and few belong to lesion or non-heal…
Cell SegmentationEnsemble LearningLesion SegmentationSegmentation+1Enhanced Generative Data Augmentation for Semantic Segmentation via Stronger Guidance
Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotat…
Data AugmentationSegmentationSemantic SegmentationLearning High-level Prior with Convolutional Neural Networks for Semantic Segmentation
This paper proposes a convolutional neural network that can fuse high-level prior for semantic image segmentation. Motivated by humans' vision recognition system, our key design is a three-layer generative structure cons…
DecoderImage SegmentationSegmentationSemantic Segmentation+1