Learning to execute instructions in a Minecraft dialogue
The Minecraft Collaborative Building Task is a two-player game in which an Architect (A) instructs a Builder (B) to construct a target structure in a simulated Blocks World Environment. We define the subtask of predicting correct action sequences (block placements and removals) in a given game context, and show that capturing B{'}s past actions as well as B{'}s perspective leads to a significant improvement in performance on this challenging language understanding problem.
Code (0)
등록된 구현이 없습니다.
Tasks
Learning to ExecuteMinecraftSimilar Papers 제목 키워드 기반
Learning to Execute Actions or Ask Clarification Questions
Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop an intelligent builder agent in a si…
Learning to ExecuteMinecraftLearning to execute or ask clarification questions
Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. To this end, we wish to develop an intelligent builder …
Learning to ExecuteMinecraftBAR: A Backward Reasoning based Agent for Complex Minecraft Tasks
Large language model (LLM) based agents have shown great potential in following human instructions and automatically completing various tasks. To complete a task, the agent needs to decompose it into easily executed step…
Large Language ModelMinecraftAnalysis of Dialogue in Human-Human Collaboration in Minecraft
Recently, many studies have focused on developing dialogue systems that enable collaborative work; however, they rarely focus on creative tasks. Collaboration for creative work, in which humans and systems collaborate to…
MinecraftWhy Build an Assistant in Minecraft?
In this document we describe a rationale for a research program aimed at building an open "assistant" in the game Minecraft, in order to make progress on the problems of natural language understanding and learning from d…
MinecraftNatural Language Understanding