Agent-Agnostic Human-in-the-Loop Reinforcement Learning

2017-01-15 · David Abel, John Salvatier, Andreas Stuhlmüller, Owain Evans

Providing Reinforcement Learning agents with expert advice can dramatically improve various aspects of learning. Prior work has developed teaching protocols that enable agents to learn efficiently in complex environments; many of these methods tailor the teacher's guidance to agents with a particular representation or underlying learning scheme, offering effective but specialized teaching procedures. In this work, we explore protocol programs, an agent-agnostic schema for Human-in-the-Loop Reinforcement Learning. Our goal is to incorporate the beneficial properties of a human teacher into Reinforcement Learning without making strong assumptions about the inner workings of the agent. We show how to represent existing approaches such as action pruning, reward shaping, and training in simulation as special cases of our schema and conduct preliminary experiments on simple domains.

📄 PDF Abstract BibTeX arXiv:1701.04079

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Battlesnake Challenge: A Multi-agent Reinforcement Learning Playground with Human-in-the-loop

2020-07-20 · Jonathan Chung, Anna Luo, Xavier Raffin, Scott Perry

We present the Battlesnake Challenge, a framework for multi-agent reinforcement learning with Human-In-the-Loop Learning (HILL). It is developed upon Battlesnake, a multiplayer extension of the traditional Snake game in …

Multi-agent Reinforcement Learning reinforcement-learning Reinforcement Learning (RL)

Advice Conformance Verification by Reinforcement Learning agents for Human-in-the-Loop

2022-10-07 · Mudit Verma, Ayush Kharkwal, Subbarao Kambhampati

Human-in-the-loop (HiL) reinforcement learning is gaining traction in domains with large action and state spaces, and sparse rewards by allowing the agent to take advice from HiL. Beyond advice accommodation, a sequentia…

Decision Making reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1

DQN-TAMER: Human-in-the-Loop Reinforcement Learning with Intractable Feedback

2018-10-28 · Riku Arakawa, Sosuke Kobayashi, Yuya Unno, Yuta Tsuboi 외

Exploration has been one of the greatest challenges in reinforcement learning (RL), which is a large obstacle in the application of RL to robotics. Even with state-of-the-art RL algorithms, building a well-learned agent …

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

A Collaborative Reasoning Framework for Anomaly Diagnostics in Underwater Robotics

2025-11-04 · Markus Buchholz, Niamh Ellis, Rahaf Abu Hara, Ignacio Carlucho 외 arxiv

The safe deployment of autonomous systems in safety-critical settings requires a paradigm that combines human expertise with AI-driven analysis, especially when anomalies are unforeseen. We introduce AURA (Autonomous Res…

Convergence of a Human-in-the-Loop Policy-Gradient Algorithm With Eligibility Trace Under Reward, Policy, and Advantage Feedback

2021-09-15 · Ishaan Shah, David Halpern, Kavosh Asadi, Michael L. Littman

Fluid human-agent communication is essential for the future of human-in-the-loop reinforcement learning. An agent must respond appropriately to feedback from its human trainer even before they have significant experience…

Q-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)