paper-with-me

Papers

Data-Driven Model Reduction using WeldNet: Windowed Encoders for Learning Dynamics

2025-12-11 · Biraj Dahal, Jiahui Cheng, Hao Liu, Rongjie Lai, Wenjing Liao arxiv

Many problems in science and engineering involve time-dependent, high dimensional datasets arising from complex physical processes, which are costly to simulate. In this work, we propose WeldNet: Windowed Encoders for Learning Dynamics, a data-driven nonlinear model reduction framework to build a low-dimensional surrogate model for complex evolution systems. Given time-dependent training data, we split the time domain into multiple overlapping windows, within which nonlinear dimension reduction is performed by auto-encoders to capture latent codes. Once a low-dimensional representation of the data is learned, a propagator network is trained to capture the evolution of the latent codes in each window, and a transcoder is trained to connect the latent codes between adjacent windows. The proposed windowed decomposition significantly simplifies propagator training by breaking long-horizon dynamics into multiple short, manageable segments, while the transcoders ensure consistency across windows. In addition to the algorithmic framework, we develop a mathematical theory establishing the representation power of WeldNet under the manifold hypothesis, justifying the success of nonlinear model reduction via deep autoencoder-based architectures. Our numerical experiments on various differential equations indicate that WeldNet can capture nonlinear latent structures and their underlying dynamics, outperforming both traditional projection-based approaches and recently developed nonlinear model reduction methods.

📄 PDF Abstract BibTeX arXiv:2512.11090

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A mathematical motivation for complex-valued convolutional networks

2015-03-11 · Joan Bruna, Soumith Chintala, Yann Lecun, Serkan Piantino 외

A complex-valued convolutional network (convnet) implements the repeated application of the following composition of three operations, recursively applying the composition to an input vector of nonnegative real numbers: …

Investigating the Effects of Sparse Attention on Cross-Encoders

2023-12-29 · Ferdinand Schlatt, Maik Fröbe, Matthias Hagen

Cross-encoders are effective passage and document re-rankers but less efficient than other neural or classic retrieval models. A few previous studies have applied windowed self-attention to make cross-encoders more effic…

Re-RankingRetrieval

Advancing Welding Defect Detection in Maritime Operations via Adapt-WeldNet and Defect Detection Interpretability Analysis

2025-08-01 · Kamal Basha S, Athira Nambiar arxiv

Weld defect detection is crucial for ensuring the safety and reliability of piping systems in the oil and gas industry, especially in challenging marine and offshore environments. Traditional non-destructive testing (NDT…

Transfer Learning

A$^2$ATS: Retrieval-Based KV Cache Reduction via Windowed Rotary Position Embedding and Query-Aware Vector Quantization

2025-02-18 · Junhui He, Junna Xing, Nan Wang, Rui Xu 외

Long context large language models (LLMs) pose significant challenges for efficient serving due to the large memory footprint and high access overhead of KV cache. Retrieval-based KV cache reduction methods can mitigate …

CPUPositionQuantizationRetrieval

Data-Driven Model Reduction and Nonlinear Model Predictive Control of an Air Separation Unit by Applied Koopman Theory

2023-09-11 · Jan C. Schulze, Danimir T. Doncevic, Nils Erwes, Alexander Mitsos

Achieving real-time capability is an essential prerequisite for the industrial implementation of nonlinear model predictive control (NMPC). Data-driven model reduction offers a way to obtain low-order control models from…

CPUmodelModel Predictive Control