Rethinking Interactive Image Segmentation: Feature Space Annotation
Despite the progress of interactive image segmentation methods, high-quality pixel-level annotation is still time-consuming and laborious - a bottleneck for several deep learning applications. We take a step back to propose interactive and simultaneous segment annotation from multiple images guided by feature space projection. This strategy is in stark contrast to existing interactive segmentation methodologies, which perform annotation in the image domain. We show that feature space annotation achieves competitive results with state-of-the-art methods in foreground segmentation datasets: iCoSeg, DAVIS, and Rooftop. Moreover, in the semantic segmentation context, it achieves 91.5% accuracy in the Cityscapes dataset, being 74.75 times faster than the original annotation procedure. Further, our contribution sheds light on a novel direction for interactive image annotation that can be integrated with existing methodologies. The supplementary material presents video demonstrations. Code available at https://github.com/LIDS-UNICAMP/rethinking-interactive-image-segmentation.
Code (1)
Tasks
Foreground SegmentationImage SegmentationInteractive SegmentationMetric LearningSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentation
Deep neural networks have become a mainstream approach to interactive segmentation. As we show in our experiments, while for some images a trained network provides accurate segmentation result with just a few clicks, for…
Interactive SegmentationSegmentationRethinking Interactive Image Segmentation with Low Latency High Quality and Diverse Prompts
The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challengin…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationRethinking Interactive Image Segmentation with Low Latency, High Quality, and Diverse Prompts
The goal of interactive image segmentation is to delineate specific regions within an image via visual or language prompts. Low-latency and high-quality interactive segmentation with diverse prompts remain challenging fo…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationBeyond Mask: Rethinking Guidance Types in Few-shot Segmentation
Existing few-shot segmentation (FSS) methods mainly focus on prototype feature generation and the query-support matching mechanism. As a crucial prompt for generating prototype features, the pair of image-mask types in t…
Interactive Full Image Segmentation by Considering All Regions Jointly
We address interactive full image annotation, where the goal is to accurately segment all object and stuff regions in an image. We propose an interactive, scribble-based annotation framework which operates on the whole i…
AllImage SegmentationInteractive SegmentationSegmentation+1