Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation
Traditional fine-grained image classification typically relies on large-scale training samples with annotated ground-truth. However, some sub-categories have few available samples in real-world applications, and current few-shot models still have difficulty in distinguishing subtle differences among fine-grained categories. To solve this challenge, we propose a novel few-shot fine-grained image classification network (FicNet) using multi-frequency neighborhood (MFN) and double-cross modulation (DCM). MFN focuses on both spatial domain and frequency domain to capture multi-frequency structural representations, which reduces the influence of appearance and background changes to the intra-class distance. DCM consists of bi-crisscross component and double 3D cross-attention component. It modulates the representations by considering global context information and inter-class relationship respectively, which enables the support and query samples respond to the same parts and accurately identify the subtle inter-class differences. The comprehensive experiments on three fine-grained benchmark datasets for two few-shot tasks verify that FicNet has excellent performance compared to the state-of-the-art methods. Especially, the experiments on two datasets, "Caltech-UCSD Birds" and "Stanford Cars", can obtain classification accuracy 93.17\% and 95.36\%, respectively. They are even higher than that the general fine-grained image classification methods can achieve.
Code (1)
Tasks
ClassificationFine-Grained Image Classificationimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
Zero-Shot Fine-Grained Image Classification Using Large Vision-Language Models
Large Vision-Language Models (LVLMs) have demonstrated impressive performance on vision-language reasoning tasks. However, their potential for zero-shot fine-grained image classification, a challenging task requiring pre…
Fine-Grained Image ClassificationRevisiting Pose-Normalization for Fine-Grained Few-Shot Recognition
Few-shot, fine-grained classification requires a model to learn subtle, fine-grained distinctions between different classes (e.g., birds) based on a few images alone. This requires a remarkable degree of invariance to po…
ClassificationGeneral ClassificationZero-Shot Fine-Grained Classification by Deep Feature Learning with Semantics
Fine-grained image classification, which aims to distinguish images with subtle distinctions, is a challenging task due to two main issues: lack of sufficient training data for every class and difficulty in learning disc…
ClassificationDomain AdaptationFine-Grained Image ClassificationGeneral Classification+3Auto-view contrastive learning for few-shot image recognition
Few-shot learning aims to recognize new classes with few annotated instances within each category. Recently, metric-based meta-learning approaches have shown the superior performance in tackling few-shot learning problem…
Contrastive LearningFew-Shot LearningFine-Grained Image ClassificationGeneral Classification+3GIST: Generating Image-Specific Text for Fine-grained Object Classification
Recent vision-language models outperform vision-only models on many image classification tasks. However, because of the absence of paired text/image descriptions, it remains difficult to fine-tune these models for fine-g…
ClassificationFine-Grained Image Classificationimage-classificationImage Classification+6