Transfer Learning in a Transductive Setting
Category models for objects or activities typically rely on supervised learning requiring sufficiently large training sets. Transferring knowledge from known categories to novel classes with no or only a few labels however is far less researched even though it is a common scenario. In this work, we extend transfer learning with semi-supervised learning to exploit unlabeled instances of (novel) categories with no or only a few labeled instances. Our proposed approach Propagated Semantic Transfer combines three main ingredients. First, we transfer information from known to novel categories by incorporating external knowledge, such as linguistic or expert-specified information, e.g., by a mid-level layer of semantic attributes. Second, we exploit the manifold structure of novel classes. More specifically we adapt a graph-based learning algorithm - so far only used for semi-supervised learning - to zero-shot and few-shot learning. Third, we improve the local neighborhood in such graph structures by replacing the raw feature-based representation with a mid-level object- or attribute-based representation. We evaluate our approach on three challenging datasets in two different applications, namely on Animals with Attributes and ImageNet for image classification and on MPII Composites for activity recognition. Our approach consistently outperforms state-of-the-art transfer and semi-supervised approaches on all datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionAttributeFew-Shot Learningimage-classificationImage ClassificationTransfer LearningSimilar Papers 제목 키워드 기반
Graph-based Interpolation of Feature Vectors for Accurate Few-Shot Classification
In few-shot classification, the aim is to learn models able to discriminate classes using only a small number of labeled examples. In this context, works have proposed to introduce Graph Neural Networks (GNNs) aiming at …
Few-Shot Image ClassificationGeneral ClassificationTransductive LearningCross-database non-frontal facial expression recognition based on transductive deep transfer learning
Cross-database non-frontal expression recognition is a very meaningful but rather difficult subject in the fields of computer vision and affect computing. In this paper, we proposed a novel transductive deep transfer lea…
Facial Expression RecognitionFacial Expression Recognition (FER)Transfer LearningTransductive conformal inference with adaptive scores
Conformal inference is a fundamental and versatile tool that provides distribution-free guarantees for many machine learning tasks. We consider the transductive setting, where decisions are made on a test sample of $m$ n…
Novelty DetectionTransfer LearningGenerative Model-driven Structure Aligning Discriminative Embeddings for Transductive Zero-shot Learning
Zero-shot Learning (ZSL) is a transfer learning technique which aims at transferring knowledge from seen classes to unseen classes. This knowledge transfer is possible because of underlying semantic space which is common…
Transfer LearningZero-Shot LearningTransductive Inference and Semi-Supervised Learning
This chapter contains sections titled: Problem Settings, Problem of Generalization in Inductive and Transductive Inference, Structure of the VC Bounds and Transductive Inference, The Symmetrization Lemma and Transductive…
LEMMA