paper-with-me

홈 › Papers

Control of Memory, Active Perception, and Action in Minecraft

2016-05-30 · Junhyuk Oh, Valliappa Chockalingam, Satinder Singh, Honglak Lee

In this paper, we introduce a new set of reinforcement learning (RL) tasks in Minecraft (a flexible 3D world). We then use these tasks to systematically compare and contrast existing deep reinforcement learning (DRL) architectures with our new memory-based DRL architectures. These tasks are designed to emphasize, in a controllable manner, issues that pose challenges for RL methods including partial observability (due to first-person visual observations), delayed rewards, high-dimensional visual observations, and the need to use active perception in a correct manner so as to perform well in the tasks. While these tasks are conceptually simple to describe, by virtue of having all of these challenges simultaneously they are difficult for current DRL architectures. Additionally, we evaluate the generalization performance of the architectures on environments not used during training. The experimental results show that our new architectures generalize to unseen environments better than existing DRL architectures.

📄 PDF Abstract BibTeX arXiv:1605.09128

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Reinforcement LearningMinecraftreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active Perception

2023-12-12 · CVPR 2024 1 · Yiran Qin, Enshen Zhou, Qichang Liu, Zhenfei Yin 외

It is a long-lasting goal to design an embodied system that can solve long-horizon open-world tasks in human-like ways. However, existing approaches usually struggle with compound difficulties caused by the logic-aware d…

Minecraft

Matrix-Game: Interactive World Foundation Model

2025-06-23 · Yifan Zhang, Chunli Peng, Boyang Wang, Puyi Wang 외

We introduce Matrix-Game, an interactive world foundation model for controllable game world generation. Matrix-Game is trained using a two-stage pipeline that first performs large-scale unlabeled pretraining for environm…

MinecraftmodelVideo Generation

ADAM: An Embodied Causal Agent in Open-World Environments

2024-10-29 · Shu Yu, Chaochao Lu

In open-world environments like Minecraft, existing agents face challenges in continuously learning structured knowledge, particularly causality. These challenges stem from the opacity inherent in black-box models and an…

Lifelong learningMinecraftNavigateWorld Knowledge

Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memory

2023-05-25 · Xizhou Zhu, Yuntao Chen, Hao Tian, Chenxin Tao 외

The captivating realm of Minecraft has attracted substantial research interest in recent years, serving as a rich platform for developing intelligent agents capable of functioning in open-world environments. However, the…

Common Sense ReasoningCPUGPUMinecraft+2

JueWu-MC: Playing Minecraft with Sample-efficient Hierarchical Reinforcement Learning

2021-12-07 · Zichuan Lin, Junyou Li, Jianing Shi, Deheng Ye 외

Learning rational behaviors in open-world games like Minecraft remains to be challenging for Reinforcement Learning (RL) research due to the compound challenge of partial observability, high-dimensional visual perception…

Efficient ExplorationHierarchical Reinforcement LearningImitation LearningMinecraft+4