Improving Deep Reinforcement Learning in Minecraft with Action Advice

2019-08-02 · Spencer Frazier, Mark Riedl

Training deep reinforcement learning agents complex behaviors in 3D virtual environments requires significant computational resources. This is especially true in environments with high degrees of aliasing, where many states share nearly identical visual features. Minecraft is an exemplar of such an environment. We hypothesize that interactive machine learning IML, wherein human teachers play a direct role in training through demonstrations, critique, or action advice, may alleviate agent susceptibility to aliasing. However, interactive machine learning is only practical when the number of human interactions is limited, requiring a balance between human teacher effort and agent performance. We conduct experiments with two reinforcement learning algorithms which enable human teachers to give action advice, Feedback Arbitration and Newtonian Action Advice, under visual aliasing conditions. To assess potential cognitive load per advice type, we vary the accuracy and frequency of various human action advice techniques. Training efficiency, robustness against infrequent and inaccurate advisor input, and sensitivity to aliasing are examined.

📄 PDF Abstract BibTeX arXiv:1908.01007

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningDeep Reinforcement LearningMinecraftreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Deep Reinforcement Learning with Model Learning and Monte Carlo Tree Search in Minecraft

2018-03-22 · Stephan Alaniz

Deep reinforcement learning has been successfully applied to several visual-input tasks using model-free methods. In this paper, we propose a model-based approach that combines learning a DNN-based transition model with …

Deep Reinforcement Learning Minecraft Reinforcement Learning Reinforcement Learning (RL)

Broad-persistent Advice for Interactive Reinforcement Learning Scenarios

2022-10-11 · Francisco Cruz, Adam Bignold, Hung Son Nguyen, Richard Dazeley 외

The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time inter…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Persistent Rule-based Interactive Reinforcement Learning

2021-02-04 · Adam Bignold, Francisco Cruz, Richard Dazeley, Peter Vamplew 외

Interactive reinforcement learning has allowed speeding up the learning process in autonomous agents by including a human trainer providing extra information to the agent in real-time. Current interactive reinforcement l…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Crafting a Pogo Stick in Minecraft with Heuristic Search (Extended Abstract)

2024-06-01 · International Symposium on Combinatorial Search 2024 6 · Yarin Benyamin, Argaman Mordoch, Shahaf Shperberg, Wiktor Piotrowski 외

Minecraft is a widely popular video game renowned for its intricate environment. The game's open-ended design allows the creation of unique tasks and challenges for the agents, providing a broad spectrum for researchers …

Heuristic Search Minecraft Reinforcement Learning (RL)

Advice Conformance Verification by Reinforcement Learning agents for Human-in-the-Loop

2022-10-07 · Mudit Verma, Ayush Kharkwal, Subbarao Kambhampati

Human-in-the-loop (HiL) reinforcement learning is gaining traction in domains with large action and state spaces, and sparse rewards by allowing the agent to take advice from HiL. Beyond advice accommodation, a sequentia…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1