Learning the Delay Using Neural Delay Differential Equations
The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous time neural network approach based on Delay Differential Equations (DDEs). Our model uses the adjoint sensitivity method to learn the model parameters and delay directly from data. Our approach is inspired by that of NODEs and extends earlier neural DDE models, which have assumed that the value of the delay is known a priori. We perform a sensitivity analysis on our proposed approach and demonstrate its ability to learn DDE parameters from benchmark systems. We conclude our discussion with potential future directions and applications.
Code (1)
Tasks
SensitivitySimilar Papers 제목 키워드 기반
Using multi-delay discrete delay differential equations to accurately simulate models with distributed delays
Delayed processes are ubiquitous throughout biology. These delays may arise through maturation processes or as the result of complex multi-step networks, and mathematical models with distributed delays are increasingly u…
A Deep Neural Network Framework for Solving Forward and Inverse Problems in Delay Differential Equations
We propose a unified framework for delay differential equations (DDEs) based on deep neural networks (DNNs) - the neural delay differential equations (NDDEs), aimed at solving the forward and inverse problems of delay di…
A Bayesian Approach for Discovering Time- Delayed Differential Equation from Data
Time-delayed differential equations (TDDEs) are widely used to model complex dynamic systems where future states depend on past states with a delay. However, inferring the underlying TDDEs from observed data remains a ch…
Bayesian InferenceEquation DiscoveryTime and State Dependent Neural Delay Differential Equations
Discontinuities and delayed terms are encountered in the governing equations of a large class of problems ranging from physics and engineering to medicine and economics. These systems cannot be properly modelled and simu…
Neural Piecewise-Constant Delay Differential Equations
Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge t…