Periodic Intra-Ensemble Knowledge Distillation for Reinforcement Learning
Off-policy ensemble reinforcement learning (RL) methods have demonstrated impressive results across a range of RL benchmark tasks. Recent works suggest that directly imitating experts' policies in a supervised manner before or during the course of training enables faster policy improvement for an RL agent. Motivated by these recent insights, we propose Periodic Intra-Ensemble Knowledge Distillation (PIEKD). PIEKD is a learning framework that uses an ensemble of policies to act in the environment while periodically sharing knowledge amongst policies in the ensemble through knowledge distillation. Our experiments demonstrate that PIEKD improves upon a state-of-the-art RL method in sample efficiency on several challenging MuJoCo benchmark tasks. Additionally, we perform ablation studies to better understand PIEKD.
Code (1)
Tasks
Knowledge DistillationMuJoCoreinforcement-learningReinforcement LearningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
An Ensemble Method of Deep Reinforcement Learning for Automated Cryptocurrency Trading
We propose an ensemble method to improve the generalization performance of trading strategies trained by deep reinforcement learning algorithms in a highly stochastic environment of intraday cryptocurrency portfolio trad…
Deep Reinforcement LearningModel Selectionreinforcement-learningReinforcement LearningDistilling Model Knowledge
Top-performing machine learning systems, such as deep neural networks, large ensembles and complex probabilistic graphical models, can be expensive to store, slow to evaluate and hard to integrate into larger systems. Id…
Bayesian InferenceBIG-bench Machine LearningKnowledge Distillationmodel+1Ensemble Modeling with Contrastive Knowledge Distillation for Sequential Recommendation
Sequential recommendation aims to capture users' dynamic interest and predicts the next item of users' preference. Most sequential recommendation methods use a deep neural network as sequence encoder to generate user and…
AttributeContrastive LearningKnowledge DistillationMulti-Task Learning+2Collaborative Inter-agent Knowledge Distillation for Reinforcement Learning
Reinforcement Learning (RL) has demonstrated promising results across several sequential decision-making tasks. However, reinforcement learning struggles to learn efficiently, thus limiting its pervasive application to s…
Decision MakingKnowledge DistillationMuJoCoreinforcement-learning+3Single-Teacher View Augmentation: Boosting Knowledge Distillation via Angular Diversity
Knowledge Distillation (KD) aims to train a lightweight student model by transferring knowledge from a large, high-capacity teacher. Recent studies have shown that leveraging diverse teacher perspectives can significantl…
Knowledge Distillation