Teaching on a Budget in Multi-Agent Deep Reinforcement Learning

2019-04-19 · Ercüment İlhan, Jeremy Gow, Diego Perez-Liebana

Deep Reinforcement Learning (RL) algorithms can solve complex sequential decision tasks successfully. However, they have a major drawback of having poor sample efficiency which can often be tackled by knowledge reuse. In Multi-Agent Reinforcement Learning (MARL) this drawback becomes worse, but at the same time, a new set of opportunities to leverage knowledge are also presented through agent interactions. One promising approach among these is peer-to-peer action advising through a teacher-student framework. Despite being introduced for single-agent RL originally, recent studies show that it can also be applied to multi-agent scenarios with promising empirical results. However, studies in this line of research are currently very limited. In this paper, we propose heuristics-based action advising techniques in cooperative decentralised MARL, using a nonlinear function approximation based task-level policy. By adopting Random Network Distillation technique, we devise a measurement for agents to assess their knowledge in any given state and be able to initiate the teacher-student dynamics with no prior role assumptions. Experimental results in a gridworld environment show that such an approach may indeed be useful and needs to be further investigated.

📄 PDF Abstract BibTeX arXiv:1905.01357

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningMulti-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Online Transfer Learning in Reinforcement Learning Domains

2015-07-02 · Yusen Zhan, Matthew E. Taylor

This paper proposes an online transfer framework to capture the interaction among agents and shows that current transfer learning in reinforcement learning is a special case of online transfer. Furthermore, this paper re…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Learning to Teach in Cooperative Multiagent Reinforcement Learning

2018-05-20 · Shayegan Omidshafiei, Dong-Ki Kim, Miao Liu, Gerald Tesauro 외

Collective human knowledge has clearly benefited from the fact that innovations by individuals are taught to others through communication. Similar to human social groups, agents in distributed learning systems would like…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Multi-Modal, Multi-Environment Machine Teaching for Robust Reward Learning

2026-07-09 · Ali Larian, Qian Lin, Chang Zong Wu, Daniel S. Brown arxiv

As autonomous agents are increasingly deployed across diverse operational contexts, aligning their behavior with human intent demands reward functions that remain robust to such changes rather than overfitting to any sin…

Reinforcement Learning

Class Teaching for Inverse Reinforcement Learners

2019-11-29 · Manuel Lopes, Francisco Melo

In this paper we propose the first machine teaching algorithm for multiple inverse reinforcement learners. Specifically, our contributions are: (i) we formally introduce the problem of teaching a sequential task to a het…

AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents

2026-07-16 · Susan Liang, Chao Huang, Filippos Bellos, Jing Bi 외 arxiv

Active visual agents solve fine-grained image tasks by interleaving reasoning with image-grounding actions across multiple turns. However, deployment-time rollout budgets are rarely fixed: some requests permit long rollo…