Frequency Guidance Matters in Few-Shot Learning
Few-shot classification aims to learn a discriminative feature representation to recognize unseen classes with few labeled support samples. While most few-shot learning methods focus on exploiting the spatial information of image samples, frequency representation has also been proven essential in classification tasks. In this paper, we investigate the effect of different frequency components on the few-shot learning tasks. To enhance the performance and generalizability of few-shot methods, we propose a novel Frequency-Guided Few-shot Learning framework (dubbed FGFL), which leverages the task-specific frequency components to adaptively mask the corresponding image information, with a novel multi-level metric learning strategy including a triplet loss among original, masked and unmasked image as well as a contrastive loss between masked and original support and query sets to exploit more discriminative information. Extensive experiments on four benchmarks under several few-shot scenarios, i.e., standard, cross-dataset, cross-domain, and coarse-to-fine annotated classification, are conducted. Both qualitative and quantitative results show that our proposed FGFL scheme can attend to the class-discriminative frequency components, thus integrating those information towards more effective and generalizable few-shot learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot LearningMetric LearningTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Correcting Neural Operator Spectral Bias via Diffusion Posterior Sampling with Sparse Observations
Neural operator surrogates (NO) approximate PDE solutions orders of magnitude faster than numerical solvers, but suffer from spectral bias: high-frequency content is systematically attenuated, limiting reliability where …
Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformer
Recently, transformers have demonstrated great potential for modeling long-term dependencies from skeleton sequences and thereby gained ever-increasing attention in skeleton action recognition. However, the existing tran…
Action RecognitionSkeleton Based Action RecognitionGuidance Source Matters: How Guidance from AI, Expert, or a Group of Analysts Impacts Visual Data Preparation and Analysis
The progress in generative AI has fueled AI-powered tools like co-pilots and assistants to provision better guidance, particularly during data analysis. However, research on guidance has not yet examined the perceived ef…
AttributeZero-Shot Low-Light Image Enhancement via Joint Frequency Domain Priors Guided Diffusion
Due to the singularity of real-world paired datasets and the complexity of low-light environments, this leads to supervised methods lacking a degree of scene generalisation. Meanwhile, limited by poor lighting and conten…
Image EnhancementImage GenerationLow-Light Image EnhancementDiffStereo: High-Frequency Aware Diffusion Model for Stereo Image Restoration
Diffusion models (DMs) have achieved promising performance in image restoration but haven't been explored for stereo images. The application of DM in stereo image restoration is confronted with a series of challenges. Th…
DeblurringImage RestorationSuper-Resolution