Cross-domain Few-shot Segmentation with Transductive Fine-tuning
Few-shot segmentation (FSS) expects models trained on base classes to work on novel classes with the help of a few support images. However, when there exists a domain gap between the base and novel classes, the state-of-the-art FSS methods may even fail to segment simple objects. To improve their performance on unseen domains, we propose to transductively fine-tune the base model on a set of query images under the few-shot setting, where the core idea is to implicitly guide the segmentation of query images using support labels. Although different images are not directly comparable, their class-wise prototypes are desired to be aligned in the feature space. By aligning query and support prototypes with an uncertainty-aware contrastive loss, and using a supervised cross-entropy loss and an unsupervised boundary loss as regularizations, our method could generalize the base model to the target domain without additional labels. We conduct extensive experiments under various cross-domain settings of natural, remote sensing, and medical images. The results show that our method could consistently and significantly improve the performance of prototypical FSS models in all cross-domain tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Cross-Domain Few-ShotMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Transductive Multi-Head Model for Cross-Domain Few-Shot Learning
In this paper, we present a new method, Transductive Multi-Head Few-Shot learning (TMHFS), to address the Cross-Domain Few-Shot Learning (CD-FSL) challenge. The TMHFS method extends the Meta-Confidence Transduction (MCT)…
Cross-Domain Few-Shotcross-domain few-shot learningData AugmentationFew-Shot LearningFew-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?
We show that the way inference is performed in few-shot segmentation tasks has a substantial effect on performances -- an aspect often overlooked in the literature in favor of the meta-learning paradigm. We introduce a t…
AllFew-Shot Semantic SegmentationLearning Cross-domain Semantic-Visual Relationships for Transductive Zero-Shot Learning
Zero-Shot Learning (ZSL) learns models for recognizing new classes. One of the main challenges in ZSL is the domain discrepancy caused by the category inconsistency between training and testing data. Domain adaptation is…
Domain AdaptationZero-Shot LearningTemporal Transductive Inference for Few-Shot Video Object Segmentation
Few-shot video object segmentation (FS-VOS) aims at segmenting video frames using a few labelled examples of classes not seen during initial training. In this paper, we present a simple but effective temporal transductiv…
Meta-LearningObjectSemantic SegmentationVideo Object Segmentation+1Transductive Information Maximization For Few-Shot Learning
We introduce Transductive Infomation Maximization (TIM) for few-shot learning. Our method maximizes the mutual information between the query features and their label predictions for a given few-shot task, in conjunction …
Few-Shot Image ClassificationFew-Shot LearningMeta-Learning