Transfer Learning via Minimizing the Performance Gap Between Domains
We propose a new principle for transfer learning, based on a straightforward intuition: if two domains are similar to each other, the model trained on one domain should also perform well on the other domain, and vice versa. To formalize this intuition, we define the performance gap as a measure of the discrepancy between the source and target domains. We derive generalization bounds for the instance weighting approach to transfer learning, showing that the performance gap can be viewed as an algorithm-dependent regularizer, which controls the model complexity. Our theoretical analysis provides new insight into transfer learning and motivates a set of general, principled rules for designing new instance weighting schemes for transfer learning. These rules lead to gapBoost, a novel and principled boosting approach for transfer learning. Our experimental evaluation on benchmark data sets shows that gapBoost significantly outperforms previous boosting-based transfer learning algorithms.
Code (1)
Tasks
Generalization BoundsTransfer LearningSimilar Papers 제목 키워드 기반
Min-Max Statistical Alignment for Transfer Learning
A profound idea in learning invariant features for transfer learning is to align statistical properties of the domains. In practice, this is achieved by minimizing the disparity between the domains, usually measured in t…
Domain AdaptationTransfer LearningUnsupervised Domain AdaptationZero-Shot LearningBridging the Source-to-target Gap for Cross-domain Person Re-Identification with Intermediate Domains
Cross-domain person re-identification (re-ID), such as unsupervised domain adaptive (UDA) re-ID, aims to transfer the identity-discriminative knowledge from the source to the target domain. Existing methods commonly cons…
Domain GeneralizationPerson Re-IdentificationTransfer LearningDomain Generalization via Selective Consistency Regularization for Time Series Classification
Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for…
ClassificationDomain GeneralizationRepresentation LearningTime Series+2Distribution Matching Prototypical Network for Unsupervised Domain Adaptation
State-of-the-art Unsupervised Domain Adaptation (UDA) methods learn transferable features by minimizing the feature distribution discrepancy between the source and target domains. Different from these methods which do no…
Domain AdaptationUnsupervised Domain AdaptationManifold Embedded Knowledge Transfer for Brain-Computer Interfaces
Transfer learning makes use of data or knowledge in one problem to help solve a different, yet related, problem. It is particularly useful in brain-computer interfaces (BCIs), for coping with variations among different s…
Domain AdaptationEEGElectroencephalogram (EEG)General Classification+1