MaskSplit: Self-supervised Meta-learning for Few-shot Semantic Segmentation
Just like other few-shot learning problems, few-shot segmentation aims to minimize the need for manual annotation, which is particularly costly in segmentation tasks. Even though the few-shot setting reduces this cost for novel test classes, there is still a need to annotate the training data. To alleviate this need, we propose a self-supervised training approach for learning few-shot segmentation models. We first use unsupervised saliency estimation to obtain pseudo-masks on images. We then train a simple prototype based model over different splits of pseudo masks and augmentations of images. Our extensive experiments show that the proposed approach achieves promising results, highlighting the potential of self-supervised training. To the best of our knowledge this is the first work that addresses unsupervised few-shot segmentation problem on natural images.
Code (1)
Tasks
Few-Shot LearningFew-Shot Semantic SegmentationMeta-LearningSaliency PredictionSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Are Few-shot Learning Benchmarks Too Simple ?
We argue that the widely used Omniglot and miniImageNet benchmarks are too simple because their class semantics do not vary across episodes, which defeats their intended purpose of evaluating few-shot classification meth…
ClassificationFew-Shot LearningOn the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting
User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many…
Few-Shot LearningKeyword SpottingMeta-LearningSelf-Supervised LearningFew-Shot Image Classification via Contrastive Self-Supervised Learning
Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. I…
ClassificationFew-Shot Image ClassificationFew-Shot LearningGeneral Classification+5Trainable Class Prototypes for Few-Shot Learning
Metric learning is a widely used method for few shot learning in which the quality of prototypes plays a key role in the algorithm. In this paper we propose the trainable prototypes for distance measure instead of the ar…
Few-Shot LearningMetric LearningSelf-Supervised LearningUnsupervised Few-Shot Image Classification+1Self-Supervised Prototypical Transfer Learning for Few-Shot Classification
Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduc…
ClassificationFew-Shot LearningGeneral ClassificationMeta-Learning+4