Optimal Neuron Selection: NK Echo State Networks for Reinforcement Learning

2015-05-07 · Darrell Whitley, Renato Tinós, Francisco Chicano

This paper introduces the NK Echo State Network. The problem of learning in the NK Echo State Network is reduced to the problem of optimizing a special form of a Spin Glass Problem known as an NK Landscape. No weight adjustment is used; all learning is accomplished by spinning up (turning on) or spinning down (turning off) neurons in order to find a combination of neurons that work together to achieve the desired computation. For special types of NK Landscapes, an exact global solution can be obtained in polynomial time using dynamic programming. The NK Echo State Network is applied to a reinforcement learning problem requiring a recurrent network: balancing two poles on a cart given no velocity information. Empirical results shows that the NK Echo State Network learns very rapidly and yields very good generalization.

📄 PDF Abstract BibTeX arXiv:1505.01887

Code (0)

등록된 구현이 없습니다.

Tasks

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Role of assortativity in predicting burst synchronization using echo state network

2021-10-11 · Mousumi Roy, Abhishek Senapati, Swarup Poria, Arindam Mishra 외

In this study, we use a reservoir computing based echo state network (ESN) to predict the collective burst synchronization of neurons. Specifically, we investigate the ability of ESN in predicting the burst synchronizati…

Time Series Time Series Analysis

Critical Echo State Networks that Anticipate Input using Morphable Transfer Functions

2016-06-12 · Norbert Michael Mayer

The paper investigates a new type of truly critical echo state networks where individual transfer functions for every neuron can be modified to anticipate the expected next input. Deviations from expected input are only …

Vocal Bursts Type Prediction

Empirical Investigation into Configuring Echo State Networks for Representative Benchmark Problem Domains

2025-08-14 · Brooke R. Weborg, Gursel Serpen arxiv

This paper examines Echo State Network, a reservoir computer, performance using four different benchmark problems, then proposes heuristics or rules of thumb for configuring the architecture, as well as the selection of …

Hyperparameter Optimization Time Series Classification Time Series Prediction

Echo State Condition at the Critical Point

2014-11-25 · Norbert Michael Mayer

Recurrent networks with transfer functions that fulfill the Lipschitz continuity with K=1 may be echo state networks if certain limitations on the recurrent connectivity are applied. It has been shown that it is sufficie…

Exploiting Multiple Timescales in Hierarchical Echo State Networks

2021-01-11 · Luca Manneschi, Matthew O. A. Ellis, Guido Gigante, Andrew C. Lin 외

Echo state networks (ESNs) are a powerful form of reservoir computing that only require training of linear output weights whilst the internal reservoir is formed of fixed randomly connected neurons. With a correctly scal…