Interactive Image Segmentation With Latent Diversity
Interactive image segmentation is characterized by multimodality. When the user clicks on a door, do they intend to select the door or the whole house? We present an end-to-end learning approach to interactive image segmentation that tackles this ambiguity. Our architecture couples two convolutional networks. The first is trained to synthesize a diverse set of plausible segmentations that conform to the user's input. The second is trained to select among these. By selecting a single solution, our approach retains compatibility with existing interactive segmentation interfaces. By synthesizing multiple diverse solutions before selecting one, the architecture is given the representational power to explore the multimodal solution space. We show that the proposed approach outperforms existing methods for interactive image segmentation, including prior work that applied convolutional networks to this problem, while being much faster.
Code (1)
Tasks
DiversityImage SegmentationInteractive SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
MultiSeg: Semantically Meaningful, Scale-Diverse Segmentations From Minimal User Input
Existing deep learning-based interactive image segmentation approaches typically assume the target-of-interest is always a single object and fail to account for the potential diversity in user expectations, thus requirin…
DiversityImage SegmentationInteractive SegmentationObject+2Rethinking Interactive Image Segmentation with Low Latency High Quality and Diverse Prompts
The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challengin…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationRethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Prompts
The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challenging fo…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationInteractive Image Selection and Training for Brain Tumor Segmentation Network
Medical image segmentation is a relevant problem, with deep learning being an exponent. However, the necessity of a high volume of fully annotated images for training massive models can be a problem, especially for appli…
Brain Tumor SegmentationDiversityImage SegmentationMedical Image Segmentation+2DGNet: Distribution Guided Efficient Learning for Oil Spill Image Segmentation
Successful implementation of oil spill segmentation in Synthetic Aperture Radar (SAR) images is vital for marine environmental protection. In this paper, we develop an effective segmentation framework named DGNet, which …
Image SegmentationSegmentationSemantic Segmentation