paper-with-me

Papers

Short note on the behavior of recurrent neural network for noisy dynamical system

2019-04-05 · Kyongmin Yeo

The behavior of recurrent neural network for the data-driven simulation of noisy dynamical systems is studied by training a set of Long Short-Term Memory Networks (LSTM) on the Mackey-Glass time series with a wide range of noise level. It is found that, as the training noise becomes larger, LSTM learns to depend more on its autonomous dynamics than the noisy input data. As a result, LSTM trained on noisy data becomes less susceptible to the perturbation in the data, but has a longer relaxation timescale. On the other hand, when trained on noiseless data, LSTM becomes extremely sensitive to a small perturbation, but is able to adjusts to the changes in the input data.

📄 PDF Abstract BibTeX arXiv:1904.05158

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

LINOCS: Lookahead Inference of Networked Operators for Continuous Stability

2024-04-28 · Noga Mudrik, Eva Yezerets, Yenho Chen, Christopher Rozell 외

Identifying latent interactions within complex systems is key to unlocking deeper insights into their operational dynamics, including how their elements affect each other and contribute to the overall system behavior. Fo…

Time Series

Deep learning algorithm for data-driven simulation of noisy dynamical system

2018-02-22 · Kyongmin Yeo, Igor Melnyk

We present a deep learning model, DE-LSTM, for the simulation of a stochastic process with an underlying nonlinear dynamics. The deep learning model aims to approximate the probability density function of a stochastic pr…

Multi-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPredictionTime Series+1

Gradient descent in higher codimension

2018-09-14 · Y. Cooper

We consider the behavior of gradient flow and of discrete and noisy gradient descent. It is commonly noted that the addition of noise to the process of discrete gradient descent can affect the trajectory of gradient desc…

Aedes-AI: Neural Network Models of Mosquito Abundance

2021-04-21 · Adrienne C. Kinney, Sean Current, Joceline Lega

We present artificial neural networks as a feasible replacement for a mechanistic model of mosquito abundance. We develop a feed-forward neural network, a long short-term memory recurrent neural network, and a gated recu…

Time SeriesTime Series Analysis

A Technical Note on the Architectural Effects on Maximum Dependency Lengths of Recurrent Neural Networks

2024-07-19 · Jonathan S. Kent, Michael M. Murray

This work proposes a methodology for determining the maximum dependency length of a recurrent neural network (RNN), and then studies the effects of architectural changes, including the number and neuron count of layers, …