Learning to Coordinate Multiple Reinforcement Learning Agents for Diverse Query Reformulation
We propose a method to efficiently learn diverse strategies in reinforcement learning for query reformulation in the tasks of document retrieval and question answering. In the proposed framework an agent consists of multiple specialized sub-agents and a meta-agent that learns to aggregate the answers from sub-agents to produce a final answer. Sub-agents are trained on disjoint partitions of the training data, while the meta-agent is trained on the full training set. Our method makes learning faster, because it is highly parallelizable, and has better generalization performance than strong baselines, such as an ensemble of agents trained on the full data. We show that the improved performance is due to the increased diversity of reformulation strategies.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityQuestion Answeringreinforcement-learningReinforcement LearningReinforcement Learning (RL)RetrievalSimilar Papers 제목 키워드 기반
Cooperative Exploration for Multi-Agent Deep Reinforcement Learning
Exploration is critical for good results in deep reinforcement learning and has attracted much attention. However, existing multi-agent deep reinforcement learning algorithms still use mostly noise-based techniques. Very…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+3Learning Coordinated Preference for Multi-Objective Multi-Agent Reinforcement Learning
Cooperative multi-objective multi-agent reinforcement learning (MOMARL) models team decision making under multiple, potentially conflicting objectives. In this setting, conflicts arise not only across objectives but also…
Multi-agent Reinforcement LearningDecision MakingCoordinated Multi-Agent Exploration Using Shared Goals
Exploration is critical for good results of deep reinforcement learning algorithms and has drawn much attention. However, existing multi-agent deep reinforcement learning algorithms still use mostly noise-based technique…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)+3Multi-level Advantage Credit Assignment for Cooperative Multi-Agent Reinforcement Learning
Cooperative multi-agent reinforcement learning (MARL) aims to coordinate multiple agents to achieve a common goal. A key challenge in MARL is credit assignment, which involves assessing each agent's contribution to the s…
Multi-agent Reinforcement LearningCoordinated Exploration via Intrinsic Rewards for Multi-Agent Reinforcement Learning
Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explo…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)