paper-with-me

Papers

Backpropagation on Dynamical Networks

2022-07-07 · Eugene Tan, Débora Corrêa, Thomas Stemler, Michael Small

Dynamical networks are versatile models that can describe a variety of behaviours such as synchronisation and feedback. However, applying these models in real world contexts is difficult as prior information pertaining to the connectivity structure or local dynamics is often unknown and must be inferred from time series observations of network states. Additionally, the influence of coupling interactions between nodes further complicates the isolation of local node dynamics. Given the architectural similarities between dynamical networks and recurrent neural networks (RNN), we propose a network inference method based on the backpropagation through time (BPTT) algorithm commonly used to train recurrent neural networks. This method aims to simultaneously infer both the connectivity structure and local node dynamics purely from observation of node states. An approximation of local node dynamics is first constructed using a neural network. This is alternated with an adapted BPTT algorithm to regress corresponding network weights by minimising prediction errors of the dynamical network based on the previously constructed local models until convergence is achieved. This method was found to be succesful in identifying the connectivity structure for coupled networks of Lorenz, Chua and FitzHugh-Nagumo oscillators. Freerun prediction performance with the resulting local models and weights was found to be comparable to the true system with noisy initial conditions. The method is also extended to non-conventional network couplings such as asymmetric negative coupling.

📄 PDF Abstract BibTeX arXiv:2207.03093

Code (0)

등록된 구현이 없습니다.

Tasks

Time Series Analysis

Similar Papers 제목 키워드 기반

Quantum Neural Machine Learning - Backpropagation and Dynamics

2016-09-22 · Carlos Pedro Gonçalves

The current work addresses quantum machine learning in the context of Quantum Artificial Neural Networks such that the networks' processing is divided in two stages: the learning stage, where the network converges to a s…

BIG-bench Machine LearningQuantum Machine Learning

Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain

2020-09-11 · Beren Millidge, Alexander Tschantz, Anil. K. Seth, Christopher L. Buckley

The backpropagation of error algorithm (backprop) has been instrumental in the recent success of deep learning. However, a key question remains as to whether backprop can be formulated in a manner suitable for implementa…

TinyProp -- Adaptive Sparse Backpropagation for Efficient TinyML On-device Learning

2023-08-17 · Marcus Rüb, Daniel Maier, Daniel Mueller-Gritschneder, Axel Sikora

Training deep neural networks using backpropagation is very memory and computationally intensive. This makes it difficult to run on-device learning or fine-tune neural networks on tiny, embedded devices such as low-power…

Optimal Control Theoretic Neural Optimizer: From Backpropagation to Dynamic Programming

2025-10-15 · Guan-Horng Liu, Tianrong Chen, Evangelos A. Theodorou arxiv

Optimization of deep neural networks (DNNs) has been a driving force in the advancement of modern machine learning and artificial intelligence. With DNNs characterized by a prolonged sequence of nonlinear propagation, de…

Neural networks with dynamical coefficients and adjustable connections on the basis of integrated backpropagation

2018-05-19 · M. N. Nazarov

We consider artificial neurons which will update their weight coefficients with an internal rule based on backpropagation, rather than using it as an external training procedure. To achieve this we include the backpropag…