Time and State Dependent Neural Delay Differential Equations
Discontinuities and delayed terms are encountered in the governing equations of a large class of problems ranging from physics and engineering to medicine and economics. These systems cannot be properly modelled and simulated with standard Ordinary Differential Equations (ODE), or data-driven approximations such as Neural Ordinary Differential Equations (NODE). To circumvent this issue, latent variables are typically introduced to solve the dynamics of the system in a higher dimensional space and obtain the solution as a projection to the original space. However, this solution lacks physical interpretability. In contrast, Delay Differential Equations (DDEs), and their data-driven approximated counterparts, naturally appear as good candidates to characterize such systems. In this work we revisit the recently proposed Neural DDE by introducing Neural State-Dependent DDE (SDDDE), a general and flexible framework that can model multiple and state- and time-dependent delays. We show that our method is competitive and outperforms other continuous-class models on a wide variety of delayed dynamical systems. Code is available at the repository \href{https://github.com/thibmonsel/Time-and-State-Dependent-Neural-Delay-Differential-Equations}{here}.
Code (1)
Similar Papers 제목 키워드 기반
A Bayesian Approach for Discovering Time- Delayed Differential Equation from Data
Time-delayed differential equations (TDDEs) are widely used to model complex dynamic systems where future states depend on past states with a delay. However, inferring the underlying TDDEs from observed data remains a ch…
Bayesian InferenceEquation DiscoverySmall time delay approximation in replicator dynamics
We present a microscopic model of replicator dynamics with strategy-dependent time delays. In such a model, new players are born from parents who interacted and received payoffs in the past. In the case of small delays, …
A Deep Neural Network Framework for Solving Forward and Inverse Problems in Delay Differential Equations
We propose a unified framework for delay differential equations (DDEs) based on deep neural networks (DNNs) - the neural delay differential equations (NDDEs), aimed at solving the forward and inverse problems of delay di…
Using multi-delay discrete delay differential equations to accurately simulate models with distributed delays
Delayed processes are ubiquitous throughout biology. These delays may arise through maturation processes or as the result of complex multi-step networks, and mathematical models with distributed delays are increasingly u…
DSSMs: State Space Models with Explicit Memory via Delay Differential Equations
State Space Models (SSMs) have emerged as a powerful paradigm for efficient long-sequence modeling, offering parallel training and fast linear-time recurrent inference. However, like other recurrent architectures, SSMs m…