BaseTransformers: Attention over base data-points for One Shot Learning
Few shot classification aims to learn to recognize novel categories using only limited samples per category. Most current few shot methods use a base dataset rich in labeled examples to train an encoder that is used for obtaining representations of support instances for novel classes. Since the test instances are from a distribution different to the base distribution, their feature representations are of poor quality, degrading performance. In this paper we propose to make use of the well-trained feature representations of the base dataset that are closest to each support instance to improve its representation during meta-test time. To this end, we propose BaseTransformers, that attends to the most relevant regions of the base dataset feature space and improves support instance representations. Experiments on three benchmark data sets show that our method works well for several backbones and achieves state-of-the-art results in the inductive one shot setting. Code is available at github.com/mayug/BaseTransformers
Code (1)
Tasks
Few-Shot Image ClassificationOne-Shot LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Coneheads: Hierarchy Aware Attention
Attention networks such as transformers have achieved state-of-the-art performance in many domains. These networks rely heavily on the dot product attention operator, which computes the similarity between two points by t…
PEAL: Prior-Embedded Explicit Attention Learning for Low-Overlap Point Cloud Registration
Learning distinctive point-wise features is critical for low-overlap point cloud registration. Recently, it has achieved huge success in incorporating Transformer into point cloud feature representation, which usuall…
Point Cloud RegistrationEffective Approaches to Attention-based Neural Machine Translation
An attentional mechanism has lately been used to improve neural machine translation (NMT) by selectively focusing on parts of the source sentence during translation. However, there has been little work exploring useful a…
Image-guided Story Ending GenerationMachine TranslationNMTSentence+1Self-positioning Point-based Transformer for Point Cloud Understanding
Transformers have shown superior performance on various computer vision tasks with their capabilities to capture long-range dependencies. Despite the success, it is challenging to directly apply Transformers on point clo…
3D Part Segmentation3D Point Cloud ClassificationScene SegmentationSemantic Segmentation+1Improving the Detection of Small Oriented Objects in Aerial Images
Small oriented objects that represent tiny pixel-area in large-scale aerial images are difficult to detect due to their size and orientation. Existing oriented aerial detectors have shown promising results but are mainly…
Instance Segmentationobject-detectionObject DetectionOriented Object Detection+1