Characterizing tradeoffs between teaching via language and demonstrations in multi-agent systems

2023-05-19 · Dhara Yu, Noah D. Goodman, Jesse Mu

Humans teach others about the world through language and demonstration. When might one of these modalities be more effective than the other? In this work, we study the factors that modulate the effectiveness of language vs. demonstration using multi-agent systems to model human communication. Specifically, we train neural network agents to teach via language or demonstration in a grounded communication task, manipulating 1) the inherent difficulty of the task and 2) the competence of the teacher. We find that teaching by demonstration is more effective in the simplest settings, but language is more effective as task difficulty increases, due to its ability to generalize more effectively to unseen scenarios. Overall, these results provide converging evidence for a tradeoff between language and demonstration as teaching modalities in humans, and make the novel predictions that demonstration may be optimal for easy tasks, while language enables generalization in more challenging settings.

📄 PDF Abstract BibTeX arXiv:2305.11374

Code (0)

등록된 구현이 없습니다.

Teaching Inverse Reinforcement Learners via Features and Demonstrations

2018-10-21 · NeurIPS 2018 12 · Luis Haug, Sebastian Tschiatschek, Adish Singla

Learning near-optimal behaviour from an expert's demonstrations typically relies on the assumption that the learner knows the features that the true reward function depends on. In this paper, we study the problem of lear…

Reinforcement Learning

Closed-loop Teaching via Demonstrations to Improve Policy Transparency

2024-04-01 · Michael S. Lee, Reid Simmons, Henny Admoni

Demonstrations are a powerful way of increasing the transparency of AI policies. Though informative demonstrations may be selected a priori through the machine teaching paradigm, student learning may deviate from the pre…

Machine Teaching for Inverse Reinforcement Learning: Algorithms and Applications

2018-05-20 · Daniel S. Brown, Scott Niekum

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

Show or Tell? Demonstration is More Robust to Changes in Shared Perception than Explanation

2020-12-16 · Theodore R. Sumers, Mark K. Ho, Thomas L. Griffiths

Successful teaching entails a complex interaction between a teacher and a learner. The teacher must select and convey information based on what they think the learner perceives and believes. Teaching always involves misa…

ZPD Teaching Strategies for Deep Reinforcement Learning from Demonstrations

2019-10-26 · Daniel Seita, David Chan, Roshan Rao, Chen Tang 외

Learning from demonstrations is a popular tool for accelerating and reducing the exploration requirements of reinforcement learning. When providing expert demonstrations to human students, we know that the demonstrations…

Atari Games Deep Reinforcement Learning Q-Learning reinforcement-learning+2