Learning to Transfer Learn: Reinforcement Learning-Based Selection for Adaptive Transfer Learning
We propose a novel adaptive transfer learning framework, learning to transfer learn (L2TL), to improve performance on a target dataset by careful extraction of the related information from a source dataset. Our framework considers cooperative optimization of shared weights between models for source and target tasks, and adjusts the constituent loss weights adaptively. The adaptation of the weights is based on a reinforcement learning (RL) selection policy, guided with a performance metric on the target validation set. We demonstrate that L2TL outperforms fine-tuning baselines and other adaptive transfer learning methods on eight datasets. In the regimes of small-scale target datasets and significant label mismatch between source and target datasets, L2TL shows particularly large benefits.
Code (0)
등록된 구현이 없습니다.
Tasks
reinforcement-learningReinforcement LearningReinforcement Learning (RL)Transfer LearningSimilar Papers 제목 키워드 기반
RADS: Reinforcement Learning-Based Sample Selection Improves Transfer Learning in Low-resource and Imbalanced Clinical Settings
A common strategy in transfer learning is few shot fine-tuning, but its success is highly dependent on the quality of samples selected as training examples. Active learning methods such as uncertainty sampling and divers…
Reinforcement LearningTransfer LearningActive LearningEnvironment-Aware Transfer Reinforcement Learning for Sustainable Beam Selection
This paper presents a novel and sustainable approach for improving beam selection in 5G and beyond networks using transfer learning and Reinforcement Learning (RL). Traditional RL-based beam selection models require exte…
Reinforcement LearningTransfer LearningPoint CloudsGeneralized Adaptive Transfer Network: Enhancing Transfer Learning in Reinforcement Learning Across Domains
Transfer learning in Reinforcement Learning (RL) enables agents to leverage knowledge from source tasks to accelerate learning in target tasks. While prior work, such as the Attend, Adapt, and Transfer (A2T) framework, a…
Atari GamesChatbotComputational EfficiencyDeep Learning+6Adaptive evolution of hybrid bacteria by horizontal gene transfer
Horizontal gene transfer is an important factor in bacterial evolution that can act across species boundaries. Yet, we know little about rate and genomic targets of cross-lineage gene transfer, and about its effects on t…
Sensitivity of Stability: Theoretical & Empirical Analysis of Replicability for Adaptive Data Selection in Transfer Learning
The widespread adoption of transfer learning has revolutionized machine learning by enabling efficient adaptation of pre-trained models to new domains. However, the reliability of these adaptations remains poorly underst…
Transfer Learning