paper-with-me

홈 › Papers

BaseTransformers: Attention over base data-points for One Shot Learning

2022-10-05 · Mayug Maniparambil, Kevin McGuinness, Noel O'Connor

Few shot classification aims to learn to recognize novel categories using only limited samples per category. Most current few shot methods use a base dataset rich in labeled examples to train an encoder that is used for obtaining representations of support instances for novel classes. Since the test instances are from a distribution different to the base distribution, their feature representations are of poor quality, degrading performance. In this paper we propose to make use of the well-trained feature representations of the base dataset that are closest to each support instance to improve its representation during meta-test time. To this end, we propose BaseTransformers, that attends to the most relevant regions of the base dataset feature space and improves support instance representations. Experiments on three benchmark data sets show that our method works well for several backbones and achieves state-of-the-art results in the inductive one shot setting. Code is available at github.com/mayug/BaseTransformers

📄 PDF Abstract BibTeX arXiv:2210.02476

Code (1)

mayug/basetransformers 공식 구현 pytorch

Tasks

Few-Shot Image ClassificationOne-Shot Learning

Methods 이 논문이 사용한 방법론

Test 설명 없음
BASE 설명 없음

Similar Papers 제목 키워드 기반

Coneheads: Hierarchy Aware Attention

2023-06-01 · NeurIPS 2023 11 · Albert Tseng, Tao Yu, Toni J. B. Liu, Christopher De Sa

Attention networks such as transformers have achieved state-of-the-art performance in many domains. These networks rely heavily on the dot product attention operator, which computes the similarity between two points by t…

PEAL: Prior-Embedded Explicit Attention Learning for Low-Overlap Point Cloud Registration

2023-01-01 · CVPR 2023 1 · Junle Yu, Luwei Ren, Yu Zhang, Wenhui Zhou 외

Learning distinctive point-wise features is critical for low-overlap point cloud registration. Recently, it has achieved huge success in incorporating Transformer into point cloud feature representation, which usuall…

Point Cloud Registration

Effective Approaches to Attention-based Neural Machine Translation

2015-08-17 · EMNLP 2015 9 · Minh-Thang Luong, Hieu Pham, Christopher D. Manning

An attentional mechanism has lately been used to improve neural machine translation (NMT) by selectively focusing on parts of the source sentence during translation. However, there has been little work exploring useful a…

Image-guided Story Ending GenerationMachine TranslationNMTSentence+1

Self-positioning Point-based Transformer for Point Cloud Understanding

2023-03-29 · CVPR 2023 1 · Jinyoung Park, Sanghyeok Lee, Sihyeon Kim, Yunyang Xiong 외

Transformers have shown superior performance on various computer vision tasks with their capabilities to capture long-range dependencies. Despite the success, it is challenging to directly apply Transformers on point clo…

3D Part Segmentation3D Point Cloud ClassificationScene SegmentationSemantic Segmentation+1

Improving the Detection of Small Oriented Objects in Aerial Images

2024-01-12 · Chandler Timm C. Doloriel, Rhandley D. Cajote

Small oriented objects that represent tiny pixel-area in large-scale aerial images are difficult to detect due to their size and orientation. Existing oriented aerial detectors have shown promising results but are mainly…

Instance Segmentationobject-detectionObject DetectionOriented Object Detection+1