Deep TAMER: Interactive Agent Shaping in High-Dimensional State Spaces

2017-09-28 · Garrett Warnell, Nicholas Waytowich, Vernon Lawhern, Peter Stone

While recent advances in deep reinforcement learning have allowed autonomous learning agents to succeed at a variety of complex tasks, existing algorithms generally require a lot of training data. One way to increase the speed at which agents are able to learn to perform tasks is by leveraging the input of human trainers. Although such input can take many forms, real-time, scalar-valued feedback is especially useful in situations where it proves difficult or impossible for humans to provide expert demonstrations. Previous approaches have shown the usefulness of human input provided in this fashion (e.g., the TAMER framework), but they have thus far not considered high-dimensional state spaces or employed the use of deep learning. In this paper, we do both: we propose Deep TAMER, an extension of the TAMER framework that leverages the representational power of deep neural networks in order to learn complex tasks in just a short amount of time with a human trainer. We demonstrate Deep TAMER's success by using it and just 15 minutes of human-provided feedback to train an agent that performs better than humans on the Atari game of Bowling - a task that has proven difficult for even state-of-the-art reinforcement learning methods.

📄 PDF Abstract BibTeX arXiv:1709.10163

Code (2)

JulienDesvergnes/human-reinforcement-learning tf

bharadwaj1098/Tamer pytorch

Tasks

Deep Reinforcement Learningreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Vocal Bursts Intensity Prediction

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

MAME: Multidimensional Adaptive Metamer Exploration with Human Perceptual Feedback

2025-03-17 · Mina Kamao, Hayato Ono, Ayumu Yamashita, Kaoru Amano 외 arxiv

Alignment between human brain networks and artificial models has become an active research area in vision science and machine learning. A widely adopted approach is identifying "metamers," stimuli physically different ye…

Image Generation

Improving Interactive Reinforcement Agent Planning with Human Demonstration

2019-04-18 · Guangliang Li, Randy Gomez, Keisuke Nakamura, Jinying Lin 외

TAMER has proven to be a powerful interactive reinforcement learning method for allowing ordinary people to teach and personalize autonomous agents' behavior by providing evaluative feedback. However, a TAMER agent plann…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Accelerating the Learning of TAMER with Counterfactual Explanations

2021-08-03 · Jakob Karalus, Felix Lindner

The capability to interactively learn from human feedback would enable agents in new settings. For example, even novice users could train service robots in new tasks naturally and interactively. Human-in-the-loop Reinfor…

counterfactual reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Facial Feedback for Reinforcement Learning: A Case Study and Offline Analysis Using the TAMER Framework

2020-01-23 · Guangliang Li, Hamdi Dibeklioğlu, Shimon Whiteson, Hayley Hung

Interactive reinforcement learning provides a way for agents to learn to solve tasks from evaluative feedback provided by a human user. Previous research showed that humans give copious feedback early in training but ver…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Towards Metamerism via Foveated Style Transfer

2017-05-29 · ICLR 2019 5 · Arturo Deza, Aditya Jonnalagadda, Miguel Eckstein

The problem of $\textit{visual metamerism}$ is defined as finding a family of perceptually indistinguishable, yet physically different images. In this paper, we propose our NeuroFovea metamer model, a foveated generative…

Decoder Metamerism Style Transfer Texture Synthesis