Attentive Weights Generation for Few Shot Learning via Information Maximization
Few shot image classification aims at learning a classifier from limited labeled data. Generating the classification weights has been applied in many meta-learning methods for few shot image classification due to its simplicity and effectiveness. In this work, we present Attentive Weights Generation for few shot learning via Information Maximization (AWGIM), which introduces two novel contributions: i) Mutual information maximization between generated weights and data within the task; this enables the generated weights to retain information of the task and the specific query sample. ii) Self-attention and cross-attention paths to encode the context of the task and individual queries. Both two contributions are shown to be very effective in extensive experiments. Overall, AWGIM is competitive with state-of-the-art. Code is available at https://github.com/Yiluan/AWGIM.
Code (1)
Tasks
ClassificationFew-Shot Image ClassificationFew-Shot LearningGeneral Classificationimage-classificationImage ClassificationMeta-LearningSimilar Papers 제목 키워드 기반
Task Discrepancy Maximization for Fine-grained Few-Shot Classification
Recognizing discriminative details such as eyes and beaks is important for distinguishing fine-grained classes since they have similar overall appearances. In this regard, we introduce Task Discrepancy Maximization (TDM)…
ClassificationFew-Shot Image ClassificationRationally Inattentive Utility Maximization for Interpretable Deep Image Classification
Are deep convolutional neural networks (CNNs) for image classification explainable by utility maximization with information acquisition costs? We demonstrate that deep CNNs behave equivalently (in terms of necessary and …
ClassificationDecision MakingGeneral Classificationimage-classification+1Multi-Level Matching and Aggregation Network for Few-Shot Relation Classification
This paper presents a multi-level matching and aggregation network (MLMAN) for few-shot relation classification. Previous studies on this topic adopt prototypical networks, which calculate the embedding vector of a query…
Few-Shot Relation ClassificationGeneral ClassificationRelationRelation ClassificationFew-Shot and Continual Learning with Attentive Independent Mechanisms
Deep neural networks (DNNs) are known to perform well when deployed to test distributions that shares high similarity with the training distribution. Feeding DNNs with new data sequentially that were unseen in the traini…
Continual LearningFew-Shot LearningMixture-of-ExpertsMotion-Attentive Transition for Zero-Shot Video Object Segmentation
In this paper, we present a novel Motion-Attentive Transition Network (MATNet) for zero-shot video object segmentation, which provides a new way of leveraging motion information to reinforce spatio-temporal object repres…
DecoderObjectSegmentationSemantic Segmentation+4