Efficacy of Modern Neuro-Evolutionary Strategies for Continuous Control Optimization
We analyze the efficacy of modern neuro-evolutionary strategies for continuous control optimization. Overall, the results collected on a wide variety of qualitatively different benchmark problems indicate that these methods are generally effective and scale well with respect to the number of parameters and the complexity of the problem. Moreover, they are relatively robust with respect to the setting of hyper-parameters. The comparison of the most promising methods indicates that the OpenAI-ES algorithm outperforms or equals the other algorithms on all considered problems. Moreover, we demonstrate how the reward functions optimized for reinforcement learning methods are not necessarily effective for evolutionary strategies and vice versa. This finding can lead to reconsideration of the relative efficacy of the two classes of algorithm since it implies that the comparisons performed to date are biased toward one or the other class.
Code (1)
Tasks
continuous-controlContinuous ControlReinforcement LearningSimilar Papers 제목 키워드 기반
An Experimental Study of Weight Initialization and Weight Inheritance Effects on Neuroevolution
Weight initialization is critical in being able to successfully train artificial neural networks (ANNs), and even more so for recurrent neural networks (RNNs) which can easily suffer from vanishing and exploding gradient…
Evolutionary AlgorithmsNeural Architecture SearchEco-evolutionary Dynamics of Non-episodic Neuroevolution in Large Multi-agent Environments
Neuroevolution (NE) has recently proven a competitive alternative to learning by gradient descent in reinforcement learning tasks. However, the majority of NE methods and associated simulation environments differ crucial…
GPUvalidA Feature-Based Comparison of Evolutionary Computing Techniques for Constrained Continuous Optimisation
Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, dif…
Evolutionary AlgorithmsEstimating parameters of nonlinear systems using the elitist particle filter based on evolutionary strategies
In this article, we present the elitist particle filter based on evolutionary strategies (EPFES) as an efficient approach for nonlinear system identification. The EPFES is derived from the frequently-employed state-space…
Acoustic echo cancellationEvolutionary Algorithmsevosax: JAX-based Evolution Strategies
The deep learning revolution has greatly been accelerated by the 'hardware lottery': Recent advances in modern hardware accelerators and compilers paved the way for large-scale batch gradient optimization. Evolutionary o…
CPUScheduling