paper-with-me

홈 › Papers

Few-Shot Learning via Embedding Adaptation with Set-to-Set Functions

2018-12-10 · CVPR 2020 6 · Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha

Learning with limited data is a key challenge for visual recognition. Many few-shot learning methods address this challenge by learning an instance embedding function from seen classes and apply the function to instances from unseen classes with limited labels. This style of transfer learning is task-agnostic: the embedding function is not learned optimally discriminative with respect to the unseen classes, where discerning among them leads to the target task. In this paper, we propose a novel approach to adapt the instance embeddings to the target classification task with a set-to-set function, yielding embeddings that are task-specific and are discriminative. We empirically investigated various instantiations of such set-to-set functions and observed the Transformer is most effective -- as it naturally satisfies key properties of our desired model. We denote this model as FEAT (few-shot embedding adaptation w/ Transformer) and validate it on both the standard few-shot classification benchmark and four extended few-shot learning settings with essential use cases, i.e., cross-domain, transductive, generalized few-shot learning, and low-shot learning. It archived consistent improvements over baseline models as well as previous methods and established the new state-of-the-art results on two benchmarks.

📄 PDF Abstract BibTeX arXiv:1812.03664

Code (6)

Sha-Lab/FEAT 공식 구현 pytorch
Alibaba-AAIG/SSL-FEW-SHOT pytorch
DanielShalam/SOT pytorch
danielshalam/bpa pytorch
han-jia/lastshot pytorch
sicara/easy-few-shot-learning pytorch

Tasks

Few-Shot Image ClassificationFew-Shot LearningGeneral ClassificationGeneralized Few-Shot LearningTransfer Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Average Pooling 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Batch Normalization 설명 없음
Bottleneck Residual Block A Bottleneck Residual Block is a variant of the residual block that utilises 1x1 convolutions to create a bottleneck. The…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Similar Papers 제목 키워드 기반

Fast Adaptation with Behavioral Foundation Models

2025-04-10 · Harshit Sikchi, Andrea Tirinzoni, Ahmed Touati, Yingchen Xu 외

Unsupervised zero-shot reinforcement learning (RL) has emerged as a powerful paradigm for pretraining behavioral foundation models (BFMs), enabling agents to solve a wide range of downstream tasks specified via reward fu…

Reinforcement Learning (RL)

Supervised Domain Adaptation: A Graph Embedding Perspective and a Rectified Experimental Protocol

2020-04-23 · arXiv 2020 4 · Lukas Hedegaard, Omar Ali Sheikh-Omar, Alexandros Iosifidis

Domain Adaptation is the process of alleviating distribution gaps between data from different domains. In this paper, we show that Domain Adaptation methods using pair-wise relationships between source and target domain …

Domain AdaptationFew-Shot LearningGraph Embedding

LP++: A Surprisingly Strong Linear Probe for Few-Shot CLIP

2024-04-02 · CVPR 2024 1 · Yunshi Huang, Fereshteh Shakeri, Jose Dolz, Malik Boudiaf 외

In a recent, strongly emergent literature on few-shot CLIP adaptation, Linear Probe (LP) has been often reported as a weak baseline. This has motivated intensive research building convoluted prompt learning or feature ad…

Prompt Learning

Domain Adaptation with a Single Vision-Language Embedding

2024-10-28 · Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez 외

Domain adaptation has been extensively investigated in computer vision but still requires access to target data at the training time, which might be difficult to obtain in some uncommon conditions. In this paper, we pres…

Domain AdaptationOne-shot Unsupervised Domain AdaptationSemantic SegmentationUnsupervised Domain Adaptation

openFEAT: Improving Speaker Identification by Open-set Few-shot Embedding Adaptation with Transformer

2022-02-24 · Kishan K C, Zhenning Tan, Long Chen, Minho Jin 외

Household speaker identification with few enrollment utterances is an important yet challenging problem, especially when household members share similar voice characteristics and room acoustics. A common embedding space …

Open Set LearningSpeaker Identification