paper-with-me

홈 › Papers

Continuous PDE Dynamics Forecasting with Implicit Neural Representations

2022-09-29 · Yuan Yin, Matthieu Kirchmeyer, Jean-Yves Franceschi, Alain Rakotomamonjy, Patrick Gallinari

Effective data-driven PDE forecasting methods often rely on fixed spatial and / or temporal discretizations. This raises limitations in real-world applications like weather prediction where flexible extrapolation at arbitrary spatiotemporal locations is required. We address this problem by introducing a new data-driven approach, DINo, that models a PDE's flow with continuous-time dynamics of spatially continuous functions. This is achieved by embedding spatial observations independently of their discretization via Implicit Neural Representations in a small latent space temporally driven by a learned ODE. This separate and flexible treatment of time and space makes DINo the first data-driven model to combine the following advantages. It extrapolates at arbitrary spatial and temporal locations; it can learn from sparse irregular grids or manifolds; at test time, it generalizes to new grids or resolutions. DINo outperforms alternative neural PDE forecasters in a variety of challenging generalization scenarios on representative PDE systems.

📄 PDF Abstract BibTeX arXiv:2209.14855

Code (1)

mkirchmeyer/DINo 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

Time Series Continuous Modeling for Imputation and Forecasting with Implicit Neural Representations

2023-06-09 · Etienne Le Naour, Louis Serrano, Léon Migus, Yuan Yin 외

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measuremen…

ImputationMeta-LearningTime Series

Temporal Variational Implicit Neural Representations

2025-06-02 · Batuhan Koyuncu, Rachael DeVries, Ole Winther, Isabel Valera

We introduce Temporal Variational Implicit Neural Representations (TV-INRs), a probabilistic framework for modeling irregular multivariate time series that enables efficient individualized imputation and forecasting. By …

ImputationMeta-LearningTime Series

Generalizable Implicit Neural Representations via Parameterized Latent Dynamics for Baroclinic Ocean Forecasting

2025-03-27 · Guang Zhao, Xihaier Luo, Seungjun Lee, Yihui Ren 외

Mesoscale ocean dynamics play a critical role in climate systems, governing heat transport, hurricane genesis, and drought patterns. However, simulating these processes at high resolution remains computationally prohibit…

Computational Efficiency

ODEBrain: Continuous-Time EEG Graph for Modeling Dynamic Brain Networks

2026-02-26 · Haohui Jia, Zheng Chen, Lingwei Zhu, Rikuto Kotoge 외 arxiv

Modeling neural population dynamics is crucial for foundational neuroscientific research and various clinical applications. Conventional latent variable methods typically model continuous brain dynamics through discretiz…

Dynamical Implicit Neural Representations

2025-11-26 · Yesom Park, Kelvin Kan, Thomas Flynn, Yi Huang 외 arxiv

Implicit Neural Representations (INRs) provide a powerful continuous framework for modeling complex visual and geometric signals, but spectral bias remains a fundamental challenge, limiting their ability to capture high-…