Reinforced Attention for Few-Shot Learning and Beyond
Few-shot learning aims to correctly recognize query samples from unseen classes given a limited number of support samples, often by relying on global embeddings of images. In this paper, we propose to equip the backbone network with an attention agent, which is trained by reinforcement learning. The policy gradient algorithm is employed to train the agent towards adaptively localizing the representative regions on feature maps over time. We further design a reward function based on the prediction of the held-out data, thus helping the attention mechanism to generalize better across the unseen classes. The extensive experiments show, with the help of the reinforced attention, that our embedding network has the capability to progressively generate a more discriminative representation in few-shot learning. Moreover, experiments on the task of image classification also show the effectiveness of the proposed design.
Code (0)
등록된 구현이 없습니다.
Tasks
Few-Shot Learningimage-classificationImage ClassificationSimilar Papers 제목 키워드 기반
RTDK-BO: High Dimensional Bayesian Optimization with Reinforced Transformer Deep kernels
Bayesian Optimization (BO), guided by Gaussian process (GP) surrogates, has proven to be an invaluable technique for efficient, high-dimensional, black-box optimization, a critical problem inherent to many applications s…
Bayesian OptimizationMeta-Learningreinforcement-learningReinforcement Learning+1Many-Shot In-Context Learning
Large language models (LLMs) excel at few-shot in-context learning (ICL) -- learning from a few examples provided in context at inference, without any weight updates. Newly expanded context windows allow us to investigat…
Few-Shot LearningIn-Context LearningReinforced Self-Attention Network: a Hybrid of Hard and Soft Attention for Sequence Modeling
Many natural language processing tasks solely rely on sparse dependencies between a few tokens in a sentence. Soft attention mechanisms show promising performance in modeling local/global dependencies by soft probabiliti…
Hard AttentionNatural Language InferenceSentenceBeyond One-Size-Fits-All: Adaptive Subgraph Denoising for Zero-Shot Graph Learning with Large Language Models
Graph-based tasks in the zero-shot setting remain a significant challenge due to data scarcity and the inability of traditional Graph Neural Networks (GNNs) to generalize to unseen domains or label spaces. While recent a…
Zero-shot GeneralizationReinforcement LearningGraph LearningReinforced Swin-Convs Transformer for Underwater Image Enhancement
Underwater Image Enhancement (UIE) technology aims to tackle the challenge of restoring the degraded underwater images due to light absorption and scattering. To address problems, a novel U-Net based Reinforced Swin-Conv…
Image EnhancementUIE