LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learning

2024-01-24 · Maofa Wang, Bingchen Yan

Few-shot image classification has emerged as a key challenge in the field of computer vision, highlighting the capability to rapidly adapt to new tasks with minimal labeled data. Existing methods predominantly rely on image-level features or local descriptors, often overlooking the holistic context surrounding these descriptors. In this work, we introduce a novel approach termed "Local Descriptor with Contextual Augmentation (LDCA)". Specifically, this method bridges the gap between local and global understanding uniquely by leveraging an adaptive global contextual enhancement module. This module incorporates a visual transformer, endowing local descriptors with contextual awareness capabilities, ranging from broad global perspectives to intricate surrounding nuances. By doing so, LDCA transcends traditional descriptor-based approaches, ensuring each local feature is interpreted within its larger visual narrative. Extensive experiments underscore the efficacy of our method, showing a maximal absolute improvement of 20\% over the next-best on fine-grained classification datasets, thus demonstrating significant advancements in few-shot classification tasks.

📄 PDF Abstract BibTeX arXiv:2401.13499

Code (0)

등록된 구현이 없습니다.

Tasks

Classification Few-Shot Image Classification Few-Shot Learning image-classification Image Classification

Feature Aligning Few shot Learning Method Using Local Descriptors Weighted Rules

2024-08-26 · Bingchen Yan

Few-shot classification involves identifying new categories using a limited number of labeled samples. Current few-shot classification methods based on local descriptors primarily leverage underlying consistent features …

Classification Few-Shot Image Classification Few-Shot Learning image-classification+1

Sparse Spatial Transformers for Few-Shot Learning

2021-09-27 · Haoxing Chen, Huaxiong Li, Yaohui Li, Chunlin Chen

Learning from limited data is challenging because data scarcity leads to a poor generalization of the trained model. A classical global pooled representation will probably lose useful local information. Many few-shot lea…

Few-Shot Image Classification Few-Shot Learning Patch Matching

Helping CLIP See Both the Forest and the Trees: A Decomposition and Description Approach

2025-07-04 · Leyan Xue, Zongbo Han, Guangyu Wang, QinGhua Hu 외

Vision-Language Models (VLMs) like CLIP achieve cross-modal semantic alignment through contrastive learning, exhibiting robust zero-shot generalization. Traditional prompt engineering, however, predominantly relies on co…

Attribute Contrastive Learning Prompt Engineering Test-time Adaptation+1

WILDCAT: Weakly Supervised Learning of Deep ConvNets for Image Classification, Pointwise Localization and Segmentation

2017-07-01 · CVPR 2017 7 · Thibaut Durand, Taylor Mordan, Nicolas Thome, Matthieu Cord

This paper introduces WILDCAT, a deep learning method which jointly aims at aligning image regions for gaining spatial invariance and learning strongly localized features. Our model is trained using only global image lab…

General Classification image-classification Image Classification Object Localization+4

TALDS-Net: Task-Aware Adaptive Local Descriptors Selection for Few-shot Image Classification

2023-12-09 · Qian Qiao, Yu Xie, Ziyin Zeng, Fanzhang Li

Few-shot image classification aims to classify images from unseen novel classes with few samples. Recent works demonstrate that deep local descriptors exhibit enhanced representational capabilities compared to image-leve…

Few-Shot Image Classification image-classification Image Classification