paper-with-me

홈 › Papers

DAW: Dynamics-Aware Weighting for Deep Learning Forecasts of Chaotic Systems

2026-08-23 · Zhou Fang, Gianmarco Mengaldo arxiv

Deep learning surrogates for forecasting chaotic dynamical systems suffer from catastrophic error accumulation over long-term autoregressive rollouts. This behavior is partly tied to the underlying systems: chaotic spatiotemporal systems, such as the Kuramoto-Sivashinsky (KS) equation, visit phase space unevenly - dominated by recurrent, low-dimensional quiescent states (e.g., near-laminar flows) and punctuated by rare, dynamically complex topological transitions (e.g., wave-merging events). Under a sample-wise uniform objective, standard neural surrogates allocate their finite capacity to the statistically numerous quiescent states, under-representing the transient regimes that trigger disproportionate, localized errors. Existing imbalanced-regression methods reweight samples by target-space density. However, statistical target-space rarity need not coincide with the intrinsic dynamical rarity - the recurrence geometry of the attractor that is the source of the imbalance. To address this, we introduce Dynamics-Aware Weighting (DAW), a data-centric objective reweighting framework. Using the local dimension $d$ from dynamical systems theory as an a priori measure of a state's active degrees of freedom, DAW reshapes the loss landscape to allocate representational capacity toward the sparse, high-$d$ regimes where forecast errors are systematically large. On the chaotic KS equation, DAW consistently outperforms uniform training, purely statistical density weighting, and its randomly permuted ablation, reducing long-term autoregressive error relative to all baselines. Event-level analysis shows that DAW achieves this by suppressing the localized error amplifications incurred during sharp jumps in $d$, which accompany complex physical processes such as wave-merging in the KS system.

📄 PDF Abstract BibTeX arXiv:2608.22277

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Training neural operators to preserve invariant measures of chaotic attractors

2023-06-01 · NeurIPS 2023 11 · Ruoxi Jiang, Peter Y. Lu, Elena Orlova, Rebecca Willett

Chaotic systems make long-horizon forecasts difficult because small perturbations in initial conditions cause trajectories to diverge at an exponential rate. In this setting, neural operators trained to minimize squared …

Contrastive Learning

ChaosNexus: A Foundation Model for ODE-based Chaotic System Forecasting with Hierarchical Multi-scale Awareness

2025-09-26 · Chang Liu, Bohao Zhao, Jingtao Ding, Yong Li arxiv

Foundation models have shown great promise in achieving zero-shot or few-shot forecasting for ODE-based chaotic systems via large-scale pretraining. However, existing architectures often fail to capture the multi-scale t…

Weather Forecasting

Transformer Learning of Chaotic Collective Dynamics in Many-Body Systems

2026-01-27 · Ho Jang, Gia-Wei Chern arxiv

Learning reduced descriptions of chaotic many-body dynamics is fundamentally challenging: although microscopic equations are Markovian, collective observables exhibit strong memory and exponential sensitivity to initial …

ECO: Energy-Constrained Operator Learning for Chaotic Dynamics with Boundedness Guarantees

2025-12-01 · Andrea Goertzen, Sunbochen Tang, Navid Azizan arxiv

Chaos is a fundamental feature of many complex dynamical systems, including weather systems and fluid turbulence. These systems are inherently difficult to predict due to their extreme sensitivity to initial conditions. …

Small-data Reduced Order Modeling of Chaotic Dynamics through SyCo-AE: Synthetically Constrained Autoencoders

2023-05-14 · Andrey A. Popov, Renato Zanetti

Data-driven reduced order modeling of chaotic dynamics can result in systems that either dissipate or diverge catastrophically. Leveraging non-linear dimensionality reduction of autoencoders and the freedom of non-linear…

Dimensionality Reduction