Attentive Prototype Few-shot Learning with Capsule Network-based Embedding
Few-shot learning, namely recognizing novel categories with a very small amount of training examples, is a challenging area of machine learning research. Traditional deep learning methods require massive training data to tune the huge number of parameters, which is often impractical and prone to over-fitting. In this work, we further research on the well-known few-shot learning method known as prototypical networks for better performance. Our contributions include (1) a new embedding structure to encode relative spatial relationships between features by applying a capsule network; (2) a new triplet loss designated to enhance the semantic feature embedding where similar samples are close to each other while dissimilar samples are farther apart; and (3) an effective non-parametric classifier termed attentive prototypes in place of the simple prototypes in current few-shot learning. The proposed attentive prototype aggregates all of the instances in a support class which are weighted by their importance, defined by the reconstruction error for a given query. The reconstruction error allows the classification posterior probability to be estimated, which corresponds to the classification confidence score. Extensive experiments on three benchmark datasets demonstrate that our approach is effective for the few-shot classification task.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationFew-Shot LearningGeneral ClassificationTripletMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
STAR-Caps: Capsule Networks with Straight-Through Attentive Routing
Capsule networks have been shown to be powerful models for image classification, thanks to their ability to represent and capture viewpoint variations of an object. However, the high computational complexity of capsule n…
ClassificationGeneral Classificationimage-classificationImage ClassificationMulti-Level Matching and Aggregation Network for Few-Shot Relation Classification
This paper presents a multi-level matching and aggregation network (MLMAN) for few-shot relation classification. Previous studies on this topic adopt prototypical networks, which calculate the embedding vector of a query…
Few-Shot Relation ClassificationGeneral ClassificationRelationRelation ClassificationFew-shot Action Recognition with Prototype-centered Attentive Learning
Few-shot action recognition aims to recognize action classes with few training samples. Most existing methods adopt a meta-learning approach with episodic training. In each episode, the few samples in a meta-training tas…
Action RecognitionContrastive LearningFew-Shot action recognitionFew Shot Action Recognition+2Deep multi-prototype capsule networks
Capsule networks are a type of neural network that identify image parts and form the instantiation parameters of a whole hierarchically. The goal behind the network is to perform an inverse computer graphics task, and th…
image-classificationImage ClassificationDependency-aware Prototype Learning for Few-shot Relation Classification
Few-shot relation classification aims to classify the relation type between two given entities in a sentence by training with a few labeled instances for each relation. However, most of existing models fail to distinguis…
ClassificationFew-Shot Relation ClassificationRelationRelation Classification+1