Cross-Domain Few-Shot Semantic Segmentation
Few-shot semantic segmentation aims at learning to segment a novel object class with only a few annotated examples. Most existing methods consider a setting where base classes are sampled from the same domain as the novel classes. However, in many applications, collecting sufficient training data for meta-learning is infeasible or impossible. In this paper, we extend few-shot semantic segmentation to a new task, called Cross-Domain Few-Shot Semantic Segmentation (CD-FSS), which aims to generalize the meta-knowledge from domains with sufficient training labels to low-resource domains. Moreover, a new benchmark for the CD-FSS task is established and characterized by a task difficulty measurement. We evaluate both representative few-shot segmentation methods and transfer learning based methods on the proposed benchmark and find that current few-shot segmentation methods fail to address CD-FSS. To tackle the challenging CD-FSS problem, we propose a novel Pyramid-Anchor-Transformation based few-shot segmentation network (PATNet), in which domain-specific features are transformed into domain-agnostic ones for downstream segmentation modules to fast adapt to unseen domains. Our model outperforms the state-of-the-art few-shot segmentation method in CD-FSS by 8.49% and 10.61% average accuracies in 1-shot and 5-shot, respectively. Code and datasets are available at https://github.com/slei109/PATNet
Code (1)
Tasks
Cross-Domain Few-ShotFew-Shot Semantic SegmentationMeta-LearningSegmentationSemantic SegmentationTransfer LearningSimilar Papers 제목 키워드 기반
Remember the Difference: Cross-Domain Few-Shot Semantic Segmentation via Meta-Memory Transfer
Few-shot semantic segmentation intends to predict pixel level categories using only a few labeled samples. Existing few-shot methods focus primarily on the categories sampled from the same distribution. Nevertheless,…
Contrastive LearningCross-Domain Few-ShotFew-Shot LearningFew-Shot Semantic Segmentation+2APSeg: Auto-Prompt Network for Cross-Domain Few-Shot Semantic Segmentation
Few-shot semantic segmentation (FSS) endeavors to segment unseen classes with only a few labeled samples. Current FSS methods are commonly built on the assumption that their training and application scenarios share simil…
Cross-Domain Few-ShotFew-Shot Semantic SegmentationSegmentationSemantic SegmentationCluster-to-adapt: Few Shot Domain Adaptation for Semantic Segmentation across Disjoint Labels
Domain adaptation for semantic segmentation across datasets consisting of the same categories has seen several recent successes. However, a more general scenario is when the source and target datasets correspond to non-o…
ClusteringDomain AdaptationSegmentationSemantic SegmentationCMP: A Composable Meta Prompt for SAM-Based Cross-Domain Few-Shot Segmentation
Cross-Domain Few-Shot Segmentation (CD-FSS) remains challenging due to limited data and domain shifts. Recent foundation models like the Segment Anything Model (SAM) have shown remarkable zero-shot generalization capabil…
Zero-shot GeneralizationCross-Domain Few-ShotWhat a MESS: Multi-Domain Evaluation of Zero-Shot Semantic Segmentation
While semantic segmentation has seen tremendous improvements in the past, there are still significant labeling efforts necessary and the problem of limited generalization to classes that have not been present during trai…
SegmentationSemantic SegmentationZero-Shot Semantic Segmentation