Mutual Reinforcement Learning

2019-07-15 · Sayanti Roy, Emily Kieson, Charles Abramson, Christopher Crick

Recently, collaborative robots have begun to train humans to achieve complex tasks, and the mutual information exchange between them can lead to successful robot-human collaborations. In this paper we demonstrate the application and effectiveness of a new approach called mutual reinforcement learning (MRL), where both humans and autonomous agents act as reinforcement learners in a skill transfer scenario over continuous communication and feedback. An autonomous agent initially acts as an instructor who can teach a novice human participant complex skills using the MRL strategy. While teaching skills in a physical (block-building) ($n=34$) or simulated (Tetris) environment ($n=31$), the expert tries to identify appropriate reward channels preferred by each individual and adapts itself accordingly using an exploration-exploitation strategy. These reward channel preferences can identify important behaviors of the human participants, because they may well exercise the same behaviors in similar situations later. In this way, skill transfer takes place between an expert system and a novice human operator. We divided the subject population into three groups and observed the skill transfer phenomenon, analyzing it with Simpson"s psychometric model. 5-point Likert scales were also used to identify the cognitive models of the human participants. We obtained a shared cognitive model which not only improves human cognition but enhances the robot's cognitive strategy to understand the mental model of its human partners while building a successful robot-human collaborative framework.

📄 PDF Abstract BibTeX arXiv:1907.06725

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Variational Approach to Mutual Information-Based Coordination for Multi-Agent Reinforcement Learning

2023-03-01 · Woojun Kim, Whiyoung Jung, Myungsik Cho, Youngchul Sung

In this paper, we propose a new mutual information framework for multi-agent reinforcement learning to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the simultaneous mu…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

M-MRE: Extending the Mutual Reinforcement Effect to Multimodal Information Extraction

2025-04-24 · Chengguang Gan, Zhixi Cai, Yanbin Wei, Yunhao Liang 외

Mutual Reinforcement Effect (MRE) is an emerging subfield at the intersection of information extraction and model interpretability. MRE aims to leverage the mutual understanding between tasks of different granularities, …

Empowerment-driven Exploration using Mutual Information Estimation

2018-10-11 · Navneet Madhu Kumar

Exploration is a difficult challenge in reinforcement learning and is of prime importance in sparse reward environments. However, many of the state of the art deep reinforcement learning algorithms, that rely on epsilon-…

Deep Reinforcement Learning Montezuma's Revenge Mutual Information Estimation reinforcement-learning+2

Promoting Cooperation in Multi-Agent Reinforcement Learning via Mutual Help

2023-02-18 · Yunbo Qiu, Yue Jin, Lebin Yu, Jian Wang 외

Multi-agent reinforcement learning (MARL) has achieved great progress in cooperative tasks in recent years. However, in the local reward scheme, where only local rewards for each agent are given without global rewards sh…

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Representation Convergence: Mutual Distillation is Secretly a Form of Regularization

2025-01-05 · Zhengpeng Xie, Jiahang Cao, Qiang Zhang, Jianxiong Zhang 외

In this paper, we argue that mutual distillation between reinforcement learning policies serves as an implicit regularization, preventing them from overfitting to irrelevant features. We highlight two key contributions: …

Deep Reinforcement Learning Form reinforcement-learning Reinforcement Learning+3