paper-with-me

Papers

KnowRU: Knowledge Reusing via Knowledge Distillation in Multi-agent Reinforcement Learning

2021-03-27 · Zijian Gao, Kele Xu, Bo Ding, Huaimin Wang, Yiying Li, Hongda Jia

Recently, deep Reinforcement Learning (RL) algorithms have achieved dramatically progress in the multi-agent area. However, training the increasingly complex tasks would be time-consuming and resources-exhausting. To alleviate this problem, efficient leveraging the historical experience is essential, which is under-explored in previous studies as most of the exiting methods may fail to achieve this goal in a continuously variational system due to their complicated design and environmental dynamics. In this paper, we propose a method, named "KnowRU" for knowledge reusing which can be easily deployed in the majority of the multi-agent reinforcement learning algorithms without complicated hand-coded design. We employ the knowledge distillation paradigm to transfer the knowledge among agents with the goal to accelerate the training phase for new tasks, while improving the asymptotic performance of agents. To empirically demonstrate the robustness and effectiveness of KnowRU, we perform extensive experiments on state-of-the-art multi-agent reinforcement learning (MARL) algorithms on collaborative and competitive scenarios. The results show that KnowRU can outperform the recently reported methods, which emphasizes the importance of the proposed knowledge reusing for MARL.

📄 PDF Abstract BibTeX arXiv:2103.14891

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningKnowledge DistillationMulti-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Distilling Cross-Task Knowledge via Relationship Matching

2020-06-01 · CVPR 2020 6 · Han-Jia Ye, Su Lu, De-Chuan Zhan

The discriminative knowledge from a high-capacity deep neural network (a.k.a. the "teacher") could be distilled to facilitate the learning efficacy of a shallow counterpart (a.k.a. the "student"). This paper deals with a…

Knowledge Distillation

Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification

2023-03-14 · Zuheng Kang, Yayun He, Jianzong Wang, Junqing Peng 외

Data-Free Knowledge Distillation (DFKD) has recently attracted growing attention in the academic community, especially with major breakthroughs in computer vision. Despite promising results, the technique has not been we…

Data-free Knowledge DistillationKnowledge DistillationSound Classification

On effects of Knowledge Distillation on Transfer Learning

2022-10-18 · Sushil Thapa

Knowledge distillation is a popular machine learning technique that aims to transfer knowledge from a large 'teacher' network to a smaller 'student' network and improve the student's performance by training it to emulate…

image-classificationImage ClassificationKnowledge DistillationTransfer Learning

Expandable Residual Approximation for Knowledge Distillation

2025-08-22 · Zhaoyi Yan, Binghui Chen, Yunfan Liu, Qixiang Ye arxiv

Knowledge distillation (KD) aims to transfer knowledge from a large-scale teacher model to a lightweight one, significantly reducing computational and storage requirements. However, the inherent learning capacity gap bet…

Knowledge DistillationObject Detection

Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks

2025-04-01 · Yuang Jia, Xiaojuan Shan, Jun Xia, Guancheng Wan 외

Data-free Knowledge Distillation (DFKD) is a method that constructs pseudo-samples using a generator without real data, and transfers knowledge from a teacher model to a student by enforcing the student to overcome dimen…

Data-free Knowledge DistillationKnowledge Distillation