Hierarchical Deep Q-Network from Imperfect Demonstrations in Minecraft
We present Hierarchical Deep Q-Network (HDQfD) that took first place in the MineRL competition. HDQfD works on imperfect demonstrations and utilizes the hierarchical structure of expert trajectories. We introduce the procedure of extracting an effective sequence of meta-actions and subgoals from demonstration data. We present a structured task-dependent replay buffer and adaptive prioritizing technique that allow the HDQfD agent to gradually erase poor-quality expert data from the buffer. In this paper, we present the details of the HDQfD algorithm and give the experimental results in the Minecraft domain.
Code (1)
Tasks
MinecraftSimilar Papers 제목 키워드 기반
Hierarchical Apprenticeship Learning from Imperfect Demonstrations with Evolving Rewards
While apprenticeship learning has shown promise for inducing effective pedagogical policies directly from student interactions in e-learning environments, most existing approaches rely on optimal or near-optimal expert d…
Forgetful Experience Replay in Hierarchical Reinforcement Learning from Demonstrations
Currently, deep reinforcement learning (RL) shows impressive results in complex gaming and robotic environments. Often these results are achieved at the expense of huge computational costs and require an incredible numbe…
Deep Reinforcement LearningHierarchical Reinforcement LearningMinecraftreinforcement-learning+2Align-RUDDER: Learning From Few Demonstrations by Reward Redistribution
Reinforcement learning algorithms require many samples when solving complex hierarchical tasks with sparse and delayed rewards. For such complex tasks, the recently proposed RUDDER uses reward redistribution to leverage …
General Reinforcement LearningMinecraftMultiple Sequence AlignmentSafe ExplorationDIP-RL: Demonstration-Inferred Preference Learning in Minecraft
In machine learning for sequential decision-making, an algorithmic agent learns to interact with an environment while receiving feedback in the form of a reward signal. However, in many unstructured real-world settings, …
Decision MakingMinecraftreinforcement-learningReinforcement Learning+2Sample Efficient Reinforcement Learning through Learning from Demonstrations in Minecraft
Sample inefficiency of deep reinforcement learning methods is a major obstacle for their use in real-world applications. In this work, we show how human demonstrations can improve final performance of agents on the Minec…
Deep Reinforcement LearningMinecraftreinforcement-learningReinforcement Learning+1