paper-with-me

홈 › Papers

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

2021-09-16 · Masaki Morimoto, Kai Fukami, Romit Maulik, Ricardo Vinuesa, Koji Fukagata

We use Gaussian stochastic weight averaging (SWAG) to assess the model-form uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the mean estimation', whereas its standard deviation can be used to construct confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of model-form uncertainty. This capability supports its use for a wide range of problems in science and engineering.

📄 PDF Abstract BibTeX arXiv:2109.08248

Code (0)

등록된 구현이 없습니다.

Tasks

regressionState EstimationUncertainty Quantification

Methods 이 논문이 사용한 방법론

Stochastic Weight Averaging Stochastic Weight Averaging is an optimization procedure that averages multiple points along the trajectory of SGD, with a cyclical or…

Similar Papers 제목 키워드 기반

Neuronal Stochastic Attention Circuit (NSAC) for Probabilistic Representation Learning

2026-05-25 · Waleed Razzaq, Yun-Bo Zhao arxiv

Reliable uncertainty quantification in continuous-time (CT) representation learning remains nascent, particularly within CT attention literature. We introduce the Neuronal Stochastic Attention Circuit (NSAC), a novel bio…

Representation LearningAutonomous Vehicles

Structure-Aware Epistemic Uncertainty Quantification for Neural Operator PDE Surrogates

2026-02-24 · Haoze Song, Zhihao Li, Mengyi Deng, Xin Li 외 arxiv

Neural operators (NOs) provide fast, resolution-invariant surrogates for mapping input fields to PDE solution fields, but their predictions can exhibit significant epistemic uncertainty due to finite data, imperfect opti…

How disentangled are your classification uncertainties?

2024-08-22 · Ivo Pascal de Jong, Andreea Ioana Sburlea, Matias Valdenegro-Toro

Uncertainty Quantification in Machine Learning has progressed to predicting the source of uncertainty in a prediction: Uncertainty from stochasticity in the data (aleatoric), or uncertainty from limitations of the model …

ClassificationDisentanglementUncertainty Quantification

Bayesian Uncertainty Estimation of Learned Variational MRI Reconstruction

2021-02-12 · Dominik Narnhofer, Alexander Effland, Erich Kobler, Kerstin Hammernik 외

Recent deep learning approaches focus on improving quantitative scores of dedicated benchmarks, and therefore only reduce the observation-related (aleatoric) uncertainty. However, the model-immanent (epistemic) uncertain…

MRI Reconstruction

SPARC: Single-Pass Scaling for Motion Forecasting with Conformal Bayesian Last Layers

2026-08-21 · Sakif Hossain, Julian Teusch, Jörg P. Müller arxiv

Human motion forecasters are increasingly accurate and fast, but reliable deployment requires uncertainty estimates that are structured, calibrated, and efficient. Bayesian and ensemble-based uncertainty estimates often …

Motion Forecasting