Scribbles for All: Benchmarking Scribble Supervised Segmentation Across Datasets
In this work, we introduce Scribbles for All, a label and training data generation algorithm for semantic segmentation trained on scribble labels. Training or fine-tuning semantic segmentation models with weak supervision has become an important topic recently and was subject to significant advances in model quality. In this setting, scribbles are a promising label type to achieve high quality segmentation results while requiring a much lower annotation effort than usual pixel-wise dense semantic segmentation annotations. The main limitation of scribbles as source for weak supervision is the lack of challenging datasets for scribble segmentation, which hinders the development of novel methods and conclusive evaluations. To overcome this limitation, Scribbles for All provides scribble labels for several popular segmentation datasets and provides an algorithm to automatically generate scribble labels for any dataset with dense annotations, paving the way for new insights and model advancements in the field of weakly supervised segmentation. In addition to providing datasets and algorithm, we evaluate state-of-the-art segmentation models on our datasets and show that models trained with our synthetic labels perform competitively with respect to models trained on manual labels. Thus, our datasets enable state-of-the-art research into methods for scribble-labeled semantic segmentation. The datasets, scribble generation algorithm, and baselines are publicly available at https://github.com/wbkit/Scribbles4All
Code (1)
Tasks
AllBenchmarkingSegmentationSemantic SegmentationWeakly supervised segmentationSimilar Papers 제목 키워드 기반
ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation
Large-scale data is of crucial importance for learning semantic segmentation models, but annotating per-pixel masks is a tedious and inefficient procedure. We note that for the topic of interactive image segmentation, sc…
Image SegmentationSegmentationSemantic SegmentationScribble2D5: Weakly-Supervised Volumetric Image Segmentation via Scribble Annotations
Recently, weakly-supervised image segmentation using weak annotations like scribbles has gained great attention, since such annotations are much easier to obtain compared to time-consuming and label-intensive labeling at…
Image SegmentationSegmentationSemantic SegmentationScribbleSeg: Scribble-based Interactive Image Segmentation
Interactive segmentation enables users to extract masks by providing simple annotations to indicate the target, such as boxes, clicks, or scribbles. Among these interaction formats, scribbles are the most flexible as the…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationScribble-based Hierarchical Weakly Supervised Learning for Brain Tumor Segmentation
The recent state-of-the-art deep learning methods have significantly improved brain tumor segmentation. However, fully supervised training requires a large amount of manually labeled masks, which is highly time-consuming…
Brain Tumor SegmentationClusteringSegmentationTumor Segmentation+2Scribble-supervised Cell Segmentation Using Multiscale Contrastive Regularization
Current state-of-the-art supervised deep learning-based segmentation approaches have demonstrated superior performance in medical image segmentation tasks. However, such supervised approaches require fully annotated pixe…
Cell SegmentationImage SegmentationMedical Image SegmentationSegmentation+2