paper-with-me

홈 › Papers

WISE: A Long-Horizon Agent in Minecraft with Why-Which Reasoning

2026-06-11 · Renmin Cheng, Changhao Chen arxiv

Rapid advances have been made in developing general-purpose embodied agent in environments like Minecraft through the adoption of LLM-augmented hierarchical approaches. Despite their promise, low-level controllers often become performance bottlenecks due to repeated execution failures. We argue that a key limitation is not only the lack of episodic memory, but also the decoupling of \textit{what-where-when} memory from \textit{which-why} reasoning. To address this, we propose \textbf{WISE} (Which-Why Informed Semantic Explorer), a long-horizon agent framework with an enhanced low-level controller equipped with a Causal Event Graph that augments episodic memory with explicit causal structure linking observations to task relevance. Unlike prior work such as MrSteve, which relies on feature similarity for retrieval, WISE enables robust recall under viewpoint changes and supports opportunistic task reordering through causal reasoning. Building on this memory, we propose an Opportunistic Task Scheduler that dynamically re-prioritizes subtasks when causally relevant opportunities are detected. We further equip WISE with a multi-scale progressive exploration strategy to provide spatially comprehensive observations for downstream reasoning. Experiments show that WISE largely improves task success and efficiency on long-horizon sparse tasks, particularly in settings requiring adaptive decision-making.

📄 PDF Abstract BibTeX arXiv:2606.12852

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policy

2025-02-27 · CVPR 2025 1 · Zaijing Li, Yuquan Xie, Rui Shao, Gongwei Chen 외

Building an agent that can mimic human behavior patterns to accomplish various open-world tasks is a long-term goal. To enable agents to effectively learn behavioral patterns across diverse tasks, a key challenge lies in…

Large Language ModelMinecraftMultimodal Large Language Model

Odyssey: Empowering Minecraft Agents with Open-World Skills

2024-07-22 · Shunyu Liu, Yaoru Li, Kongcheng Zhang, Zhenyu Cui 외

Recent studies have delved into constructing generalist agents for open-world environments like Minecraft. Despite the encouraging results, existing efforts mainly focus on solving basic programmatic tasks, e.g., materia…

Language ModellingLarge Language ModelMinecraftQuestion Answering

MineEvolve: Self-Evolution with Accumulated Knowledge for Long-Horizon Embodied Minecraft Agents

2026-03-13 · Zhengwei Xie, Zhisheng Chen, Ziyan Weng, Jinhan Li 외 arxiv

Long-horizon embodied intelligence requires agents to improve through interaction, not merely to execute plans generated from static goals. A central challenge is therefore to transform past executions into knowledge tha…

JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models

2023-11-10 · ZiHao Wang, Shaofei Cai, Anji Liu, Yonggang Jin 외

Achieving human-like planning and control with multimodal observations in an open world is a key milestone for more functional generalist agents. Existing approaches can handle certain long-horizon tasks in an open world…

Minecraft

Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks

2023-03-29 · Haoqi Yuan, Chi Zhang, Hongcheng Wang, Feiyang Xie 외

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inef…

MinecraftMulti-Task Learningreinforcement-learningReinforcement Learning (RL)