Domain Adaptation for Reinforcement Learning on the Atari

2018-12-18 · Thomas Carr, Maria Chli, George Vogiatzis

Deep reinforcement learning agents have recently been successful across a variety of discrete and continuous control tasks; however, they can be slow to train and require a large number of interactions with the environment to learn a suitable policy. This is borne out by the fact that a reinforcement learning agent has no prior knowledge of the world, no pre-existing data to depend on and so must devote considerable time to exploration. Transfer learning can alleviate some of the problems by leveraging learning done on some source task to help learning on some target task. Our work presents an algorithm for initialising the hidden feature representation of the target task. We propose a domain adaptation method to transfer state representations and demonstrate transfer across domains, tasks and action spaces. We utilise adversarial domain adaptation ideas combined with an adversarial autoencoder architecture. We align our new policies' representation space with a pre-trained source policy, taking target task data generated from a random policy. We demonstrate that this initialisation step provides significant improvement when learning a new reinforcement learning task, which highlights the wide applicability of adversarial adaptation methods; even as the task and label/action space also changes.

📄 PDF Abstract BibTeX arXiv:1812.07452

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-control Continuous ControlDeep Reinforcement LearningDomain Adaptation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)Transfer Learning

Methods 이 논문이 사용한 방법론

Solana Customer Service Number +1-833-534-1729 설명 없음

Physical Atari: A Robust and Accessible Platform for Real-time Reinforcement Learning on Robots

2026-05-29 · Khurram Javed, Joseph Modayil, Gloria Kennickell, Richard S. Sutton 외 arxiv

We built a robot called the Robotroller that actuates an Atari CX40+ controller and a device called the Atari Devbox that renders the game frame and the reward signal from the Arcade Learning Environment on a screen. The…

Reinforcement Learning

AdaRL: What, Where, and How to Adapt in Transfer Reinforcement Learning

2021-07-06 · ICLR 2022 4 · Biwei Huang, Fan Feng, Chaochao Lu, Sara Magliacane 외

One practical challenge in reinforcement learning (RL) is how to make quick adaptations when faced with new environments. In this paper, we propose a principled framework for adaptive RL, called \textit{AdaRL}, that adap…

Atari Games reinforcement-learning Reinforcement Learning (RL)Transfer Reinforcement Learning

Explaining Deep Reinforcement Learning Agents In The Atari Domain through a Surrogate Model

2021-10-07 · Alexander Sieusahai, Matthew Guzdial

One major barrier to applications of deep Reinforcement Learning (RL) both inside and outside of games is the lack of explainability. In this paper, we describe a lightweight and effective method to derive explanations f…

Atari Games Decision Making Deep Reinforcement Learning reinforcement-learning+1

Maximum Entropy Dueling Network Architecture in Atari Domain

2021-07-30 · Alireza Nadali, Mohammad Mehdi Ebadzadeh

In recent years, there have been many deep structures for Reinforcement Learning, mainly for value function estimation and representations. These methods achieved great success in Atari 2600 domain. In this paper, we pro…

reinforcement-learning Reinforcement Learning (RL)

Virtual Augmented Reality for Atari Reinforcement Learning

2023-10-12 · Christian A. Schiller

Reinforcement Learning (RL) has achieved significant milestones in the gaming domain, most notably Google DeepMind's AlphaGo defeating human Go champion Ken Jie. This victory was also made possible through the Atari Lear…

Image Segmentation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1