paper-with-me

Papers

Implicit factorized transformer approach to fast prediction of turbulent channel flows

2024-12-25 · Huiyu Yang, Yunpeng Wang, Jianchun Wang

Transformer neural operators have recently become an effective approach for surrogate modeling of systems governed by partial differential equations (PDEs). In this paper, we introduce a modified implicit factorized transformer (IFactFormer-m) model which replaces the original chained factorized attention with parallel factorized attention. The IFactFormer-m model successfully performs long-term predictions for turbulent channel flow, whereas the original IFactFormer (IFactFormer-o), Fourier neural operator (FNO), and implicit Fourier neural operator (IFNO) exhibit a poor performance. Turbulent channel flows are simulated by direct numerical simulation using fine grids at friction Reynolds numbers $\text{Re}_{\tau}\approx 180,395,590$, and filtered to coarse grids for training neural operator. The neural operator takes the current flow field as input and predicts the flow field at the next time step, and long-term prediction is achieved in the posterior through an autoregressive approach. The results show that IFactFormer-m, compared to other neural operators and the traditional large eddy simulation (LES) methods including dynamic Smagorinsky model (DSM) and the wall-adapted local eddy-viscosity (WALE) model, reduces prediction errors in the short term, and achieves stable and accurate long-term prediction of various statistical properties and flow structures, including the energy spectrum, mean streamwise velocity, root mean square (rms) values of fluctuating velocities, Reynolds shear stress, and spatial structures of instantaneous velocity. Moreover, the trained IFactFormer-m is much faster than traditional LES methods. By analyzing the attention kernels, we elucidate the reasons why IFactFormer-m converges faster and achieves a stable and accurate long-term prediction compared to IFactFormer-o. Code and data are available at: https://github.com/huiyu-2002/IFactFormer-m.

📄 PDF Abstract BibTeX arXiv:2412.18840

Code (1)

huiyu-2002/ifactformer-m 공식 구현 pytorch

Tasks

FrictionPrediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Neural Multigrid Memory For Computational Fluid Dynamics

2023-06-21 · Duc Minh Nguyen, Minh Chau Vu, Tuan Anh Nguyen, Tri Huynh 외

Turbulent flow simulation plays a crucial role in various applications, including aircraft and ship design, industrial process optimization, and weather prediction. In this paper, we propose an advanced data-driven metho…

Computational EfficiencyPredictionVideo Prediction

Rank-Factorized Implicit Neural Bias: Scaling Super-Resolution Transformer with FlashAttention

2026-03-06 · Dongheon Lee, Seokju Yun, Jaegyun Im, Youngmin Ro arxiv

Recent Super-Resolution~(SR) methods mainly adopt Transformers for their strong long-range modeling capability and exceptional representational capacity. However, most SR Transformers rely heavily on relative positional …

Long-range modeling

Factorized Implicit Global Convolution for Automotive Computational Fluid Dynamics Prediction

2025-02-06 · Chris Choy, Alexey Kamenev, Jean Kossaifi, Max Rietmann 외

Computational Fluid Dynamics (CFD) is crucial for automotive design, requiring the analysis of large 3D point clouds to study how vehicle geometry affects pressure fields and drag forces. However, existing deep learning …

TPTNet: A Data-Driven Temperature Prediction Model Based on Turbulent Potential Temperature

2023-12-22 · Jun Park, Changhoon Lee

A data-driven model for predicting the surface temperature using neural networks was proposed to alleviate the computational burden of numerical weather prediction (NWP). Our model, named TPTNet uses only 2m temperature …

CaFA: Global Weather Forecasting with Factorized Attention on Sphere

2024-05-12 · Zijie Li, Anthony Zhou, Saurabh Patil, Amir Barati Farimani

Accurate weather forecasting is crucial in various sectors, impacting decision-making processes and societal events. Data-driven approaches based on machine learning models have recently emerged as a promising alternativ…

PredictionWeather Forecasting