paper-with-me

홈 › Papers

Spatio-temporal Fourier Transformer (StFT) for Long-term Dynamics Prediction

2025-03-14 · Da Long, Shandian Zhe, Samuel Williams, Leonid Oliker, Zhe Bai

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales and the interplay of diverse physical processes. Neural operators have emerged as promising models for predicting such dynamics due to their flexibility and computational efficiency. However, they often fail to effectively capture multi-scale interactions or quantify the uncertainties inherent in the predictions. These limitations lead to rapid error accumulation, particularly in long-term forecasting of systems characterized by complex and coupled dynamics. To address these challenges, we propose a spatio-temporal Fourier transformer (StFT), in which each transformer block is designed to learn dynamics at a specific scale. By leveraging a structured hierarchy of StFT blocks, the model explicitly captures dynamics across both macro- and micro- spatial scales. Furthermore, a generative residual correction mechanism is integrated to estimate and mitigate predictive uncertainties, enhancing both the accuracy and reliability of long-term forecasts. Evaluations conducted on three benchmark datasets (plasma, fluid, and atmospheric dynamics) demonstrate the advantages of our approach over state-of-the-art ML methods.

📄 PDF Abstract BibTeX arXiv:2503.11899

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Depthwise Spatio-Temporal STFT Convolutional Neural Networks for Human Action Recognition

2020-07-22 · Sudhakar Kumawat, Manisha Verma, Yuta Nakashima, Shanmuganathan Raman

Conventional 3D convolutional neural networks (CNNs) are computationally expensive, memory intensive, prone to overfitting, and most importantly, there is a need to improve their feature learning capabilities. To address…

Action RecognitionTemporal Action Localization

Forecasting Geopolitical Events with a Sparse Temporal Fusion Transformer and Gaussian Process Hybrid: A Case Study in Middle Eastern and U.S. Conflict Dynamics

2025-06-26 · Hsin-Hsiung Huang, Hayden Hampton

Forecasting geopolitical conflict from data sources like the Global Database of Events, Language, and Tone (GDELT) is a critical challenge for national security. The inherent sparsity, burstiness, and overdispersion of s…

Uncertainty Quantification

Efficient Transformer-based Speech Enhancement Using Long Frames and STFT Magnitudes

2022-06-23 · Danilo de Oliveira, Tal Peer, Timo Gerkmann

The SepFormer architecture shows very good results in speech separation. Like other learned-encoder models, it uses short frames, as they have been shown to obtain better performance in these cases. This results in a lar…

Speech EnhancementSpeech Separation

iSTFTNet2: Faster and More Lightweight iSTFT-Based Neural Vocoder Using 1D-2D CNN

2023-08-14 · Takuhiro Kaneko, Hirokazu Kameoka, Kou Tanaka, Shogo Seki

The inverse short-time Fourier transform network (iSTFTNet) has garnered attention owing to its fast, lightweight, and high-fidelity speech synthesis. It obtains these characteristics using a fast and lightweight 1D CNN …

Speech Synthesis

Frequency-Undersampled Short-Time Fourier Transform

2020-10-28 · Daichi Kitahara

The short-time Fourier transform (STFT) usually computes the same number of frequency components as the frame length while overlapping adjacent time frames by more than half. As a result, the number of components of a sp…