Spatial Contrastive Learning for Few-Shot Classification
In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable features. In particular, we present a novel attention-based spatial contrastive objective to learn locally discriminative and class-agnostic features. As a result, our approach overcomes some of the limitations of the cross-entropy loss, such as its excessive discrimination towards seen classes, which reduces the transferability of features to unseen classes. With extensive experiments, we show that the proposed method outperforms state-of-the-art approaches, confirming the importance of learning good and transferable embeddings for few-shot learning.
Code (1)
Tasks
ClassificationContrastive LearningFew-Shot LearningGeneral ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
S3Net: Spectral–Spatial Siamese Network for Few-Shot Hyperspectral Image Classification
Deep learning (DL) has shown great potential for hyperspectral image (HSI) classification due to its powerful ability of nonlinear modeling and end-to-end optimization. However, DL models easily get trapped into overfitt…
ClassificationHyperspectral Image Classificationimage-classificationImage ClassificationFLAVARS: A Multimodal Foundational Language and Vision Alignment Model for Remote Sensing
Remote sensing imagery is dense with objects and contextual visual information. There is a recent trend to combine paired satellite images and text captions for pretraining performant encoders for downstream tasks. Howev…
ClassificationContrastive LearningSemantic Segmentationzero-shot-classification+1Dual Contrastive Network for Few-Shot Remote Sensing Image Scene Classification
Few-shot remote sensing image scene classification (FS-RSISC) aims at classifying remote sensing images with only a few labeled samples. The main challenges lie in small inter-class variances and large intra-class varian…
Scene ClassificationContrastive LearningSCENEFORGE: Enhancing 3D-text alignment with Structured Scene Compositions
The whole is greater than the sum of its parts-even in 3D-text contrastive learning. We introduce SceneForge, a novel framework that enhances contrastive alignment between 3D point clouds and text through structured mult…
Visual Question AnsweringContrastive LearningSpatial ReasoningPoint CloudsPESCO: Prompt-enhanced Self Contrastive Learning for Zero-shot Text Classification
We present PESCO, a novel contrastive learning framework that substantially improves the performance of zero-shot text classification. We formulate text classification as a neural text matching problem where each documen…
ClassificationContrastive Learningtext-classificationText Classification+2