paper-with-me

홈 › Papers

Exploring Cross-Domain Few-Shot Classification via Frequency-Aware Prompting

2024-06-24 · Tiange Zhang, Qing Cai, Feng Gao, Lin Qi, Junyu Dong

Cross-Domain Few-Shot Learning has witnessed great stride with the development of meta-learning. However, most existing methods pay more attention to learning domain-adaptive inductive bias (meta-knowledge) through feature-wise manipulation or task diversity improvement while neglecting the phenomenon that deep networks tend to rely more on high-frequency cues to make the classification decision, which thus degenerates the robustness of learned inductive bias since high-frequency information is vulnerable and easy to be disturbed by noisy information. Hence in this paper, we make one of the first attempts to propose a Frequency-Aware Prompting method with mutual attention for Cross-Domain Few-Shot classification, which can let networks simulate the human visual perception of selecting different frequency cues when facing new recognition tasks. Specifically, a frequency-aware prompting mechanism is first proposed, in which high-frequency components of the decomposed source image are switched either with normal distribution sampling or zeroing to get frequency-aware augment samples. Then, a mutual attention module is designed to learn generalizable inductive bias under CD-FSL settings. More importantly, the proposed method is a plug-and-play module that can be directly applied to most off-the-shelf CD-FLS methods. Experimental results on CD-FSL benchmarks demonstrate the effectiveness of our proposed method as well as robustly improve the performance of existing CD-FLS methods. Resources at https://github.com/tinkez/FAP_CDFSC.

📄 PDF Abstract BibTeX arXiv:2406.16422

Code (1)

tinkez/fap_cdfsc 공식 구현 pytorch

Tasks

Cross-Domain Few-Shotcross-domain few-shot learningFew-Shot LearningInductive BiasMeta-Learning

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Frequency Guidance Matters in Few-Shot Learning

2023-01-01 · ICCV 2023 1 · Hao Cheng, Siyuan Yang, Joey Tianyi Zhou, Lanqing Guo 외

Few-shot classification aims to learn a discriminative feature representation to recognize unseen classes with few labeled support samples. While most few-shot learning methods focus on exploiting the spatial informa…

Few-Shot LearningMetric LearningTriplet

Few-Shot Learning by Integrating Spatial and Frequency Representation

2021-05-11 · Xiangyu Chen, Guanghui Wang

Human beings can recognize new objects with only a few labeled examples, however, few-shot learning remains a challenging problem for machine learning systems. Most previous algorithms in few-shot learning only utilize s…

ClassificationFew-Shot Image ClassificationFew-Shot Learning

Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation

2022-07-18 · Hegui Zhu, Zhan Gao, Jiayi Wang, Yange Zhou 외

Traditional fine-grained image classification typically relies on large-scale training samples with annotated ground-truth. However, some sub-categories have few available samples in real-world applications, and current …

ClassificationFine-Grained Image Classificationimage-classificationImage Classification

A novel spatial-frequency domain network for zero-shot incremental learning

2024-02-11 · Jie Ren, Yang Zhao, Weichuan Zhang, Changming Sun

Zero-shot incremental learning aims to enable the model to generalize to new classes without forgetting previously learned classes. However, the semantic gap between old and new sample classes can lead to catastrophic fo…

image-classificationImage ClassificationIncremental LearningTranslation

FAMNet: Frequency-aware Matching Network for Cross-domain Few-shot Medical Image Segmentation

2024-12-12 · Yuntian Bo, Yazhou Zhu, Lunbo Li, Haofeng Zhang

Existing few-shot medical image segmentation (FSMIS) models fail to address a practical issue in medical imaging: the domain shift caused by different imaging techniques, which limits the applicability to current FSMIS t…

Cross-Domain Few-ShotDomain GeneralizationFew-Shot Semantic SegmentationImage Segmentation+4