Accelerating Deep Neuroevolution on Distributed FPGAs for Reinforcement Learning Problems

2020-05-10 · Alexis Asseman, Nicolas Antoine, Ahmet S. Ozcan

Reinforcement learning augmented by the representational power of deep neural networks, has shown promising results on high-dimensional problems, such as game playing and robotic control. However, the sequential nature of these problems poses a fundamental challenge for computational efficiency. Recently, alternative approaches such as evolutionary strategies and deep neuroevolution demonstrated competitive results with faster training time on distributed CPU cores. Here, we report record training times (running at about 1 million frames per second) for Atari 2600 games using deep neuroevolution implemented on distributed FPGAs. Combined hardware implementation of the game console, image pre-processing and the neural network in an optimized pipeline, multiplied with the system level parallelism enabled the acceleration. These results are the first application demonstration on the IBM Neural Computer, which is a custom designed system that consists of 432 Xilinx FPGAs interconnected in a 3D mesh network topology. In addition to high performance, experiments also showed improvement in accuracy for all games compared to the CPU-implementation of the same algorithm.

📄 PDF Abstract BibTeX arXiv:2005.04536

Code (0)

등록된 구현이 없습니다.

Tasks

Atari Games Computational EfficiencyCPUreinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Neuroevolving Electronic Dynamical Networks

2024-04-06 · Derek Whitley

Neuroevolution is a powerful method of applying an evolutionary algorithm to refine the performance of artificial neural networks through natural selection; however, the fitness evaluation of these networks can be time-c…

Dynamic neural networks

FPGA-based Accelerators of Deep Learning Networks for Learning and Classification: A Review

2019-01-01 · Ahmad Shawahna, Sadiq M. Sait, Aiman El-Maleh

Due to recent advances in digital technologies, and availability of credible data, an area of artificial intelligence, deep learning, has emerged, and has demonstrated its ability and effectiveness in solving complex lea…

CPU Deep Learning General Classification

VINE: An Open Source Interactive Data Visualization Tool for Neuroevolution

2018-05-03 · Rui Wang, Jeff Clune, Kenneth O. Stanley

Recent advances in deep neuroevolution have demonstrated that evolutionary algorithms, such as evolution strategies (ES) and genetic algorithms (GA), can scale to train deep neural networks to solve difficult reinforceme…

Data Visualization Evolutionary Algorithms Reinforcement Learning Reinforcement Learning (RL)

An Efficient Application of Neuroevolution for Competitive Multiagent Learning

2021-05-23 · Unnikrishnan Rajendran Menon, Anirudh Rajiv Menon

Multiagent systems provide an ideal environment for the evaluation and analysis of real-world problems using reinforcement learning algorithms. Most traditional approaches to multiagent learning are affected by long trai…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

NEORL: NeuroEvolution Optimization with Reinforcement Learning

2021-12-01 · Majdi I. Radaideh, Katelin Du, Paul Seurin, Devin Seyler 외

We present an open-source Python framework for NeuroEvolution Optimization with Reinforcement Learning (NEORL) developed at the Massachusetts Institute of Technology. NEORL offers a global optimization interface of state…

Benchmarking global-optimization reinforcement-learning Reinforcement Learning+1