홈 › Papers

Evolving Reinforcement Learning Algorithms

2021-01-08 · ICLR 2021 1 · John D. Co-Reyes, Yingjie Miao, Daiyi Peng, Esteban Real, Sergey Levine, Quoc V. Le, Honglak Lee, Aleksandra Faust

We propose a method for meta-learning reinforcement learning algorithms by searching over the space of computational graphs which compute the loss function for a value-based model-free RL agent to optimize. The learned algorithms are domain-agnostic and can generalize to new environments not seen during training. Our method can both learn from scratch and bootstrap off known existing algorithms, like DQN, enabling interpretable modifications which improve performance. Learning from scratch on simple classical control and gridworld tasks, our method rediscovers the temporal-difference (TD) algorithm. Bootstrapped from DQN, we highlight two learned algorithms which obtain good generalization performance over other classical control tasks, gridworld type tasks, and Atari games. The analysis of the learned algorithm behavior shows resemblance to recently proposed RL algorithms that address overestimation in value-based methods.

📄 PDF Abstract BibTeX arXiv:2101.03958

Code (5)

google/brain_autorl 공식 구현 tf

google/brain_autorl/tree/main/evolving_rl 공식 구현 tf

AurelianTactics/dqnclipped_dqnreg_prelim_implementation pytorch

jcoreyes/evolvingrl

jjgarau/DAGPolicyGradient

Tasks

Atari Games Meta-Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Q-Learning Q-Learning is an off-policy temporal difference control algorithm: $$Q\left(S\_{t}, A\_{t}\right) \leftarrow Q\left(S\_{t}, A\_{t}\right) + \alpha\left[R_{t+1} +…

DQN A DQN, or Deep Q-Network, approximates a state-value function in a Q-Learning framework with a neural network. In the Atari…

L2Explorer: A Lifelong Reinforcement Learning Assessment Environment

2022-03-14 · Erik C. Johnson, Eric Q. Nguyen, Blake Schreurs, Chigozie S. Ewulum 외

Despite groundbreaking progress in reinforcement learning for robotics, gameplay, and other complex domains, major challenges remain in applying reinforcement learning to the evolving, open-world problems often found in …

Continual Learning Lifelong learning reinforcement-learning Reinforcement Learning+2

Evolving Neural Networks in Reinforcement Learning by means of UMDAc

2019-04-24 · Mikel Malagon, Josu Ceberio

Neural networks are gaining popularity in the reinforcement learning field due to the vast number of successfully solved complex benchmark problems. In fact, artificial intelligence algorithms are, in some cases, able to…

OpenAI Gym reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Storehouse: a Reinforcement Learning Environment for Optimizing Warehouse Management

2022-07-08 · Julen Cestero, Marco Quartulli, Alberto Maria Metelli, Marcello Restelli

Warehouse Management Systems have been evolving and improving thanks to new Data Intelligence techniques. However, many current optimizations have been applied to specific cases or are in great need of manual interaction…

Management reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Evolving Constrained Reinforcement Learning Policy

2023-04-19 · Chengpeng Hu, Jiyuan Pei, Jialin Liu, Xin Yao

Evolutionary algorithms have been used to evolve a population of actors to generate diverse experiences for training reinforcement learning agents, which helps to tackle the temporal credit assignment problem and improve…

Evolutionary Algorithms reinforcement-learning Reinforcement Learning

Demonstration Guided Multi-Objective Reinforcement Learning

2024-04-05 · Junlin Lu, Patrick Mannion, Karl Mason

Multi-objective reinforcement learning (MORL) is increasingly relevant due to its resemblance to real-world scenarios requiring trade-offs between multiple objectives. Catering to diverse user preferences, traditional re…

Multi-Objective Reinforcement Learning reinforcement-learning Reinforcement Learning