홈 › Papers

The MineRL 2019 Competition on Sample Efficient Reinforcement Learning using Human Priors

2019-04-22 · William H. Guss, Cayden Codel, Katja Hofmann, Brandon Houghton, Noboru Kuno, Stephanie Milani, Sharada Mohanty, Diego Perez Liebana, Ruslan Salakhutdinov, Nicholay Topin, Manuela Veloso, Phillip Wang

Though deep reinforcement learning has led to breakthroughs in many difficult domains, these successes have required an ever-increasing number of samples. As state-of-the-art reinforcement learning (RL) systems require an exponentially increasing number of samples, their development is restricted to a continually shrinking segment of the AI community. Likewise, many of these systems cannot be applied to real-world problems, where environment samples are expensive. Resolution of these limitations requires new, sample-efficient methods. To facilitate research in this direction, we introduce the MineRL Competition on Sample Efficient Reinforcement Learning using Human Priors. The primary goal of the competition is to foster the development of algorithms which can efficiently leverage human demonstrations to drastically reduce the number of samples needed to solve complex, hierarchical, and sparse environments. To that end, we introduce: (1) the Minecraft ObtainDiamond task, a sequential decision making environment requiring long-term planning, hierarchical control, and efficient exploration methods; and (2) the MineRL-v0 dataset, a large-scale collection of over 60 million state-action pairs of human demonstrations that can be resimulated into embodied trajectories with arbitrary modifications to game state and visuals. Participants will compete to develop systems which solve the ObtainDiamond task with a limited number of samples from the environment simulator, Malmo. The competition is structured into two rounds in which competitors are provided several paired versions of the dataset and environment with different game textures. At the end of each round, competitors will submit containerized versions of their learning algorithms and they will then be trained/evaluated from scratch on a hold-out dataset-environment pair for a total of 4-days on a prespecified hardware platform.

📄 PDF Abstract BibTeX arXiv:1904.10079

Code (1)

shadowyzy/NIPS2019-MineRL-Competition-solution pytorch

Tasks

Decision MakingDeep Reinforcement LearningEfficient ExplorationMinecraftreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Sequential Decision Making

Retrospective Analysis of the 2019 MineRL Competition on Sample Efficient Reinforcement Learning

2020-03-10 · Stephanie Milani, Nicholay Topin, Brandon Houghton, William H. Guss 외

To facilitate research in the direction of sample efficient reinforcement learning, we held the MineRL Competition on Sample Efficient Reinforcement Learning Using Human Priors at the Thirty-third Conference on Neural In…

Deep Reinforcement Learning Imitation Learning reinforcement-learning Reinforcement Learning+1

The MineRL 2020 Competition on Sample Efficient Reinforcement Learning using Human Priors

2021-01-26 · William H. Guss, Mario Ynocente Castro, Sam Devlin, Brandon Houghton 외

Although deep reinforcement learning has led to breakthroughs in many difficult domains, these successes have required an ever-increasing number of samples, affording only a shrinking segment of the AI community access t…

Decision Making Deep Reinforcement Learning Efficient Exploration Minecraft+3

SEIHAI: A Sample-efficient Hierarchical AI for the MineRL Competition

2021-11-17 · Hangyu Mao, Chao Wang, Xiaotian Hao, Yihuan Mao 외

The MineRL competition is designed for the development of reinforcement learning and imitation learning algorithms that can efficiently leverage human demonstrations to drastically reduce the number of environment intera…

Imitation Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learned

2022-02-17 · Anssi Kanervisto, Stephanie Milani, Karolis Ramanauskas, Nicholay Topin 외

Reinforcement learning competitions advance the field by providing appropriate scope and support to develop solutions toward a specific problem. To promote the development of more broadly applicable methods, organizers n…

Sample Efficient Reinforcement Learning through Learning from Demonstrations in Minecraft

2020-03-12 · Christian Scheller, Yanick Schraner, Manfred Vogel

Sample inefficiency of deep reinforcement learning methods is a major obstacle for their use in real-world applications. In this work, we show how human demonstrations can improve final performance of agents on the Minec…

Deep Reinforcement Learning Minecraft reinforcement-learning Reinforcement Learning+1