Unsupervised Meta-learning of Figure-Ground Segmentation via Imitating Visual Effects
This paper presents a "learning to learn" approach to figure-ground image segmentation. By exploring webly-abundant images of specific visual effects, our method can effectively learn the visual-effect internal representations in an unsupervised manner and uses this knowledge to differentiate the figure from the ground in an image. Specifically, we formulate the meta-learning process as a compositional image editing task that learns to imitate a certain visual effect and derive the corresponding internal representation. Such a generative process can help instantiate the underlying figure-ground notion and enables the system to accomplish the intended image segmentation. Whereas existing generative methods are mostly tailored to image synthesis or style transfer, our approach offers a flexible learning mechanism to model a general concept of figure-ground segmentation from unorganized images that have no explicit pixel-level annotations. We validate our approach via extensive experiments on six datasets to demonstrate that the proposed model can be end-to-end trained without ground-truth pixel labeling yet outperforms the existing methods of unsupervised segmentation tasks.
Code (3)
Tasks
Image GenerationImage SegmentationMeta-LearningSegmentationSemantic SegmentationStyle TransferSimilar Papers 제목 키워드 기반
Sequential Convex Relaxation for Mutual Information-Based Unsupervised Figure-Ground Segmentation
We propose an optimization algorithm for mutual-information-based unsupervised figure-ground separation. The algorithm jointly estimates the color distributions of the foreground and background, and separates them based …
SegmentationLearning Fuzzy Clustering for SPECT/CT Segmentation via Convolutional Neural Networks
Quantitative bone single-photon emission computed tomography (QBSPECT) has the potential to provide a better quantitative assessment of bone metastasis than planar bone scintigraphy due to its ability to better quantify …
ClusteringImage SegmentationMedical Image SegmentationSegmentation+1PaintSeg: Training-free Segmentation via Painting
The paper introduces PaintSeg, a new unsupervised method for segmenting objects without any training. We propose an adversarial masked contrastive painting (AMCP) process, which creates a contrast between the original im…
Referring Image Matting (Prompt-based)SegmentationZero Shot SegmentationPaintSeg: Painting Pixels for Training-free Segmentation
The paper introduces PaintSeg, a new unsupervised method for segmenting objects without any training. We propose an adversarial masked contrastive painting (AMCP) process, which creates a contrast between the original im…
Unsupervised Detection of Metaphorical Adjective-Noun Pairs
Metaphor is a popular figure of speech. Popularity of metaphors calls for their automatic identification and interpretation. Most of the unsupervised methods directed at detection of metaphors use some hand-coded knowled…
ClusteringMachine TranslationWord Sense Disambiguation