paper-with-me

홈 › Papers

Waveformer for modelling dynamical systems

2023-10-08 · N Navaneeth, Souvik Chakraborty

Neural operators have gained recognition as potent tools for learning solutions of a family of partial differential equations. The state-of-the-art neural operators excel at approximating the functional relationship between input functions and the solution space, potentially reducing computational costs and enabling real-time applications. However, they often fall short when tackling time-dependent problems, particularly in delivering accurate long-term predictions. In this work, we propose "waveformer", a novel operator learning approach for learning solutions of dynamical systems. The proposed waveformer exploits wavelet transform to capture the spatial multi-scale behavior of the solution field and transformers for capturing the long horizon dynamics. We present four numerical examples involving Burgers's equation, KS-equation, Allen Cahn equation, and Navier Stokes equation to illustrate the efficacy of the proposed approach. Results obtained indicate the capability of the proposed waveformer in learning the solution operator and show that the proposed Waveformer can learn the solution operator with high accuracy, outperforming existing state-of-the-art operator learning algorithms by up to an order, with its advantage particularly visible in the extrapolation region

📄 PDF Abstract BibTeX arXiv:2310.04990

Code (0)

등록된 구현이 없습니다.

Tasks

Operator learning

Similar Papers 제목 키워드 기반

WaveFormer: Wavelet Embedding Transformer for Biomedical Signals

2026-02-12 · Habib Irani, Bikram De, Vangelis Metsis arxiv

Biomedical signal classification presents unique challenges due to long sequences, complex temporal dynamics, and multi-scale frequency patterns that are poorly captured by standard transformer architectures. We propose …

Human Activity RecognitionTime Series Classification

Geometry adaptive waveformer for cardio-vascular modeling

2025-03-21 · Navaneeth N, Souvik Chakraborty

Modeling cardiovascular anatomies poses a significant challenge due to their complex, irregular structures and inherent pathological conditions. Numerical simulations, while accurate, are often computationally expensive,…

Decoder

TFWaveFormer: Temporal-Frequency Collaborative Multi-level Wavelet Transformer for Dynamic Link Prediction

2026-03-04 · Hantong Feng, Yonggang Wu, Duxin Chen, Wenwu Yu arxiv

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promi…

Dynamic Link PredictionGraph Learning

WaveFormer: A 3D Transformer with Wavelet-Driven Feature Representation for Efficient Medical Image Segmentation

2025-03-31 · Md Mahfuz Al Hasan, Mahdi Zaman, Abdul Jawad, Alberto Santamaria-Pang 외

Transformer-based architectures have advanced medical image analysis by effectively modeling long-range dependencies, yet they often struggle in 3D settings due to substantial memory overhead and insufficient capture of …

Image SegmentationMedical Image AnalysisMedical Image SegmentationSemantic Segmentation

Work in Progress: Linear Transformers for TinyML

2024-03-25 · Design, Automation & Test in Europe Conference & Exhibition (DATE) 2024 3 · Moritz Scherer, Cristian Cioflan, Michele Magno, Luca Benini

We present the WaveFormer, a neural network architecture based on a linear attention transformer to enable long sequence inference for TinyML devices. Waveformer achieves a new state-of-the-art accuracy of 98.8 % and 99.…

Keyword SpottingKeyword Spotting on Google Speech CommandsQuantization