Exploring Cross-Domain Few-Shot Classification via Frequency-Aware Prompting
Cross-Domain Few-Shot Learning has witnessed great stride with the development of meta-learning. However, most existing methods pay more attention to learning domain-adaptive inductive bias (meta-knowledge) through feature-wise manipulation or task diversity improvement while neglecting the phenomenon that deep networks tend to rely more on high-frequency cues to make the classification decision, which thus degenerates the robustness of learned inductive bias since high-frequency information is vulnerable and easy to be disturbed by noisy information. Hence in this paper, we make one of the first attempts to propose a Frequency-Aware Prompting method with mutual attention for Cross-Domain Few-Shot classification, which can let networks simulate the human visual perception of selecting different frequency cues when facing new recognition tasks. Specifically, a frequency-aware prompting mechanism is first proposed, in which high-frequency components of the decomposed source image are switched either with normal distribution sampling or zeroing to get frequency-aware augment samples. Then, a mutual attention module is designed to learn generalizable inductive bias under CD-FSL settings. More importantly, the proposed method is a plug-and-play module that can be directly applied to most off-the-shelf CD-FLS methods. Experimental results on CD-FSL benchmarks demonstrate the effectiveness of our proposed method as well as robustly improve the performance of existing CD-FLS methods. Resources at https://github.com/tinkez/FAP_CDFSC.
Code (1)
Tasks
Cross-Domain Few-Shotcross-domain few-shot learningFew-Shot LearningInductive BiasMeta-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Frequency Guidance Matters in Few-Shot Learning
Few-shot classification aims to learn a discriminative feature representation to recognize unseen classes with few labeled support samples. While most few-shot learning methods focus on exploiting the spatial informa…
Few-Shot LearningMetric LearningTripletFew-Shot Learning by Integrating Spatial and Frequency Representation
Human beings can recognize new objects with only a few labeled examples, however, few-shot learning remains a challenging problem for machine learning systems. Most previous algorithms in few-shot learning only utilize s…
ClassificationFew-Shot Image ClassificationFew-Shot LearningFew-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation
Traditional fine-grained image classification typically relies on large-scale training samples with annotated ground-truth. However, some sub-categories have few available samples in real-world applications, and current …
ClassificationFine-Grained Image Classificationimage-classificationImage ClassificationA novel spatial-frequency domain network for zero-shot incremental learning
Zero-shot incremental learning aims to enable the model to generalize to new classes without forgetting previously learned classes. However, the semantic gap between old and new sample classes can lead to catastrophic fo…
image-classificationImage ClassificationIncremental LearningTranslationFAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image Segmentation
Existing few-shot medical image segmentation (FSMIS) models fail to address a practical issue in medical imaging: the domain shift caused by different imaging techniques, which limits the applicability to current FSMIS t…
Cross-Domain Few-ShotDomain GeneralizationFew-Shot Semantic SegmentationImage Segmentation+4