ToyBox: Better Atari Environments for Testing Reinforcement Learning Agents
It is a widely accepted principle that software without tests has bugs. Testing reinforcement learning agents is especially difficult because of the stochastic nature of both agents and environments, the complexity of state-of-the-art models, and the sequential nature of their predictions. Recently, the Arcade Learning Environment (ALE) has become one of the most widely used benchmark suites for deep learning research, and state-of-the-art Reinforcement Learning (RL) agents have been shown to routinely equal or exceed human performance on many ALE tasks. Since ALE is based on emulation of original Atari games, the environment does not provide semantically meaningful representations of internal game state. This means that ALE has limited utility as an environment for supporting testing or model introspection. We propose ToyBox, a collection of reimplementations of these games that solves this critical problem and enables robust testing of RL agents.
Code (3)
Tasks
Atari Gamesreinforcement-learningReinforcement LearningReinforcement Learning (RL)Similar Papers 제목 키워드 기반
Toybox: A Suite of Environments for Experimental Evaluation of Deep Reinforcement Learning
Evaluation of deep reinforcement learning (RL) is inherently challenging. In particular, learned policies are largely opaque, and hypotheses about the behavior of deep RL agents are difficult to test in black-box environ…
Deep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)The Indoor-Training Effect: unexpected gains from distribution shifts in the transition function
Is it better to perform tennis training in a pristine indoor environment or a noisy outdoor one? To model this problem, here we investigate whether shifts in the transition probabilities between the training and testing …
Atari GamesReinforcement Learning (RL)OCAtari: Object-Centric Atari 2600 Reinforcement Learning Environments
Cognitive science and psychology suggest that object-centric representations of complex scenes are a promising step towards enabling efficient abstract reasoning from low-level perceptual features. Yet, most deep reinfor…
Atari GamesDeep Reinforcement LearningObjectObject Discovery+3HackAtari: Atari Learning Environments for Robust and Continual Reinforcement Learning
Artificial agents' adaptability to novelty and alignment with intended behavior is crucial for their effective deployment. Reinforcement learning (RL) leverages novelty as a means of exploration, yet agents often struggl…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)A Deep Learning Approach for Joint Video Frame and Reward Prediction in Atari Games
Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model…
Atari GamesModel-based Reinforcement LearningPredictionreinforcement-learning+2