paper-with-me

Papers

Modeling Nonlinear Dynamics in Continuous Time with Inductive Biases on Decay Rates and/or Frequencies

2022-12-26 · Tomoharu Iwata, Yoshinobu Kawahara

We propose a neural network-based model for nonlinear dynamics in continuous time that can impose inductive biases on decay rates and/or frequencies. Inductive biases are helpful for training neural networks especially when training data are small. The proposed model is based on the Koopman operator theory, where the decay rate and frequency information is used by restricting the eigenvalues of the Koopman operator that describe linear evolution in a Koopman space. We use neural networks to find an appropriate Koopman space, which are trained by minimizing multi-step forecasting and backcasting errors using irregularly sampled time-series data. Experiments on various time-series datasets demonstrate that the proposed method achieves higher forecasting performance given a single short training sequence than the existing methods.

📄 PDF Abstract BibTeX arXiv:2212.13033

Code (0)

등록된 구현이 없습니다.

Tasks

Time SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

Nonlocal Bayesian Modeling of Continuous Spatio-Temporal Dynamics

2026-06-12 · Jaeyeong Lee, Heeyoung Kim arxiv

Real-world spatio-temporal forecasting must handle irregular time points, spatially sparse observations, and the need for uncertainty quantification. This setting is often further compounded by nonlocal interactions (lon…

Bayesian Inference

ControlSynth Neural ODEs: Modeling Dynamical Systems with Guaranteed Convergence

2024-11-04 · Wenjie Mei, Dongzhe Zheng, Shihua Li

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Man…

FLUID: Continuous-Time Hyperconnected Sparse Transformer for Sink-Free Learning

2026-05-06 · Waleed Razzaq, Yun-Bo Zhao arxiv

Continuous-time (CT) Transformers improve irregular and long-range modeling over CT-RNNs by exploiting inputs or outputs embeddings with continuous dynamics. However, the core scaled-dot-product-attention (SDPA) mechanis…

Long-range modelingAutonomous Vehicles

Adaptive Oscillatory Inductive Bias for Modeling Sharp Prosodic Dynamics in Diffusion-Based TTS

2026-06-24 · Sandipan Dhar, Nirmesh J. Shah, Ashishkumar P. Gudmalwar, Pankaj Wasnik arxiv

Diffusion-based text-to-speech (TTS) models have achieved significant improvements in speech quality. However, modeling sharp prosodic transitions and rapid pitch variations in expressive speech remains challenging. Exis…

Continuous Temporal Graph Networks for Event-Based Graph Data

2022-05-31 · NAACL (DLG4NLP) 2022 7 · Jin Guo, Zhen Han, Zhou Su, Jiliang Li 외

There has been an increasing interest in modeling continuous-time dynamics of temporal graph data. Previous methods encode time-evolving relational information into a low-dimensional representation by specifying discrete…

Graph Neural Network