Fine-Grained Few Shot Learning with Foreground Object Transformation
Traditional fine-grained image classification generally requires abundant labeled samples to deal with the low inter-class variance but high intra-class variance problem. However, in many scenarios we may have limited samples for some novel sub-categories, leading to the fine-grained few shot learning (FG-FSL) setting. To address this challenging task, we propose a novel method named foreground object transformation (FOT), which is composed of a foreground object extractor and a posture transformation generator. The former aims to remove image background, which tends to increase the difficulty of fine-grained image classification as it amplifies the intra-class variance while reduces inter-class variance. The latter transforms the posture of the foreground object to generate additional samples for the novel sub-category. As a data augmentation method, FOT can be conveniently applied to any existing few shot learning algorithm and greatly improve its performance on FG-FSL tasks. In particular, in combination with FOT, simple fine-tuning baseline methods can be competitive with the state-of-the-art methods both in inductive setting and transductive setting. Moreover, FOT can further boost the performances of latest excellent methods and bring them up to the new state-of-the-art. In addition, we also show the effectiveness of FOT on general FSL tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationFew-Shot LearningFine-Grained Image Classificationimage-classificationImage ClassificationObjectSimilar Papers 제목 키워드 기반
Boosting Few-shot Fine-grained Recognition with Background Suppression and Foreground Alignment
Few-shot fine-grained recognition (FS-FGR) aims to recognize novel fine-grained categories with the help of limited available samples. Undoubtedly, this task inherits the main challenges from both few-shot learning and f…
Few-Shot LearningObject-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification
The goal of few-shot fine-grained image classification is to recognize rarely seen fine-grained objects in the query set, given only a few samples of this class in the support set. Previous works focus on learning discri…
Fine-Grained Image Classificationimage-classificationImage ClassificationObject+3Pro2SAM: Mask Prompt to SAM with Grid Points for Weakly Supervised Object Localization
Weakly Supervised Object Localization (WSOL), which aims to localize objects by only using image-level labels, has attracted much attention because of its low annotation cost in real applications. Current studies focus o…
Object LocalizationWeakly-Supervised Object LocalizationZero-shot GeneralizationFB-CLIP: Fine-Grained Zero-Shot Anomaly Detection with Foreground-Background Disentanglement
Fine-grained anomaly detection is crucial in industrial and medical applications, but labeled anomalies are often scarce, making zero-shot detection challenging. While vision-language models like CLIP offer promising sol…
Anomaly DetectionExploring Localization for Self-supervised Fine-grained Contrastive Learning
Self-supervised contrastive learning has demonstrated great potential in learning visual representations. Despite their success in various downstream tasks such as image classification and object detection, self-supervis…
Contrastive LearningFine-Grained Image ClassificationFine-Grained Image Recognitionimage-classification+2