Generalized Few-Shot Semantic Segmentation: All You Need is Fine-Tuning
Generalized few-shot semantic segmentation was introduced to move beyond only evaluating few-shot segmentation models on novel classes to include testing their ability to remember base classes. While the current state-of-the-art approach is based on meta-learning, it performs poorly and saturates in learning after observing only a few shots. We propose the first fine-tuning solution, and demonstrate that it addresses the saturation problem while achieving state-of-the-art results on two datasets, PASCAL-5i and COCO-20i. We also show that it outperforms existing methods, whether fine-tuning multiple final layers or only the final layer. Finally, we present a triplet loss regularization that shows how to redistribute the balance of performance between novel and base categories so that there is a smaller gap between them.
Code (0)
등록된 구현이 없습니다.
Tasks
AllFew-Shot Semantic SegmentationGeneralized Few-Shot Semantic SegmentationMeta-LearningSegmentationSemantic SegmentationTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generalized Few-Shot Semantic Segmentation in Remote Sensing: Challenge and Benchmark
Learning with limited labelled data is a challenging problem in various applications, including remote sensing. Few-shot semantic segmentation is one approach that can encourage deep learning models to learn from few lab…
Few-Shot Semantic SegmentationGeneralized Few-Shot Semantic SegmentationSegmentationSemantic SegmentationA Language-Guided Benchmark for Weakly Supervised Open Vocabulary Semantic Segmentation
Increasing attention is being diverted to data-efficient problem settings like Open Vocabulary Semantic Segmentation (OVSS) which deals with segmenting an arbitrary object that may or may not be seen during training. The…
Few-Shot Semantic SegmentationLanguage ModellingOpen Vocabulary Semantic SegmentationOpen-Vocabulary Semantic Segmentation+3SIGN: Spatial-information Incorporated Generative Network for Generalized Zero-shot Semantic Segmentation
Unlike conventional zero-shot classification, zero-shot semantic segmentation predicts a class label at the pixel level instead of the image level. When solving zero-shot semantic segmentation problems, the need for pixe…
Knowledge DistillationSegmentationSemantic Segmentationzero-shot-classification+2Generalized Few-shot Semantic Segmentation
Training semantic segmentation models requires a large amount of finely annotated data, making it hard to quickly adapt to novel classes not satisfying this condition. Few-Shot Segmentation (FS-Seg) tackles this problem …
Few-Shot Semantic SegmentationGeneralized Few-Shot Semantic SegmentationSegmentationSemantic SegmentationGeneralized Few-Shot Meets Remote Sensing: Discovering Novel Classes in Land Cover Mapping via Hybrid Semantic Segmentation Framework
Land-cover mapping is one of the vital applications in Earth observation, aiming at classifying each pixel's land-cover type of remote-sensing images. As natural and human activities change the landscape, the land-cover …
Earth ObservationSegmentationSemantic Segmentation