paper-with-me

홈 › Papers

BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks

2023-12-05 · NeurIPS 2023 11 · Stephanie Milani, Anssi Kanervisto, Karolis Ramanauskas, Sander Schulhoff, Brandon Houghton, Rohin Shah

The MineRL BASALT competition has served to catalyze advances in learning from human feedback through four hard-to-specify tasks in Minecraft, such as create and photograph a waterfall. Given the completion of two years of BASALT competitions, we offer to the community a formalized benchmark through the BASALT Evaluation and Demonstrations Dataset (BEDD), which serves as a resource for algorithm development and performance assessment. BEDD consists of a collection of 26 million image-action pairs from nearly 14,000 videos of human players completing the BASALT tasks in Minecraft. It also includes over 3,000 dense pairwise human evaluations of human and algorithmic agents. These comparisons serve as a fixed, preliminary leaderboard for evaluating newly-developed algorithms. To enable this comparison, we present a streamlined codebase for benchmarking new algorithms against the leaderboard. In addition to presenting these datasets, we conduct a detailed analysis of the data from both datasets to guide algorithm development and evaluation. The released code and data are available at https://github.com/minerllabs/basalt-benchmark .

📄 PDF Abstract BibTeX arXiv:2312.02405

Code (1)

minerllabs/basalt-benchmark 공식 구현 pytorch

Tasks

BenchmarkingMinecraft

Similar Papers 제목 키워드 기반

Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition

2023-03-23 · Stephanie Milani, Anssi Kanervisto, Karolis Ramanauskas, Sander Schulhoff 외

To facilitate research in the direction of fine-tuning foundation models from human feedback, we held the MineRL BASALT Competition on Fine-Tuning from Human Feedback at NeurIPS 2022. The BASALT challenge asks teams to c…

Minecraft

Behavioral Cloning via Search in Embedded Demonstration Dataset

2023-06-15 · Federico Malato, Florian Leopold, Ville Hautamaki, Andrew Melnik

Behavioural cloning uses a dataset of demonstrations to learn a behavioural policy. To overcome various learning and policy adaptation problems, we propose to use latent space to index a demonstration dataset, instantly …

Behavioural cloningMinecraft

Zero-shot Imitation Policy via Search in Demonstration Dataset

2024-01-29 · Federco Malato, Florian Leopold, Andrew Melnik, Ville Hautamaki

Behavioral cloning uses a dataset of demonstrations to learn a policy. To overcome computationally expensive training procedures and address the policy adaptation problem, we propose to use latent spaces of pre-trained f…

Imitation LearningMinecraft

The MineRL BASALT Competition on Learning from Human Feedback

2021-07-05 · Rohin Shah, Cody Wild, Steven H. Wang, Neel Alex 외

The last decade has seen a significant increase of interest in deep learning research, with many public successes that have demonstrated its potential. As such, these systems are now being incorporated into commercial pr…

Imitation LearningMinecraft

Behavioral Cloning via Search in Video PreTraining Latent Space

2022-12-27 · Federico Malato, Florian Leopold, Amogh Raut, Ville Hautamäki 외

Our aim is to build autonomous agents that can solve tasks in environments like Minecraft. To do so, we used an imitation learning-based approach. We formulate our control problem as a search problem over a dataset of ex…

Imitation LearningMinecraft