paper-with-me

홈 › Papers

A Benchmark on Uncertainty Quantification for Deep Learning Prognostics

2023-02-09 · Luis Basora, Arthur Viens, Manuel Arias Chao, Xavier Olive

Reliable uncertainty quantification on RUL prediction is crucial for informative decision-making in predictive maintenance. In this context, we assess some of the latest developments in the field of uncertainty quantification for prognostics deep learning. This includes the state-of-the-art variational inference algorithms for Bayesian neural networks (BNN) as well as popular alternatives such as Monte Carlo Dropout (MCD), deep ensembles (DE) and heteroscedastic neural networks (HNN). All the inference techniques share the same inception deep learning architecture as a functional model. We performed hyperparameter search to optimize the main variational and learning parameters of the algorithms. The performance of the methods is evaluated on a subset of the large NASA NCMAPSS dataset for aircraft engines. The assessment includes RUL prediction accuracy, the quality of predictive uncertainty, and the possibility to break down the total predictive uncertainty into its aleatoric and epistemic parts. The results show no method clearly outperforms the others in all the situations. Although all methods are close in terms of accuracy, we find differences in the way they estimate uncertainty. Thus, DE and MCD generally provide more conservative predictive uncertainty than BNN. Surprisingly, HNN can achieve strong results without the added training complexity and extra parameters of the BNN. For tasks like active learning where a separation of epistemic and aleatoric uncertainty is required, radial BNN and MCD seem the best options.

📄 PDF Abstract BibTeX arXiv:2302.04730

Code (1)

lbasora/bayesrul pytorch

Tasks

Active LearningDecision MakingDeep LearningUncertainty QuantificationVariational Inference

Methods 이 논문이 사용한 방법론

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Deep Ensembles 설명 없음
Variational Inference 설명 없음
Monte Carlo Dropout 설명 없음

Similar Papers 제목 키워드 기반

Data-driven Prognostics with Predictive Uncertainty Estimation using Ensemble of Deep Ordinal Regression Models

2019-03-23 · Vishnu TV, Diksha, Pankaj Malhotra, Lovekesh Vig 외

Prognostics or Remaining Useful Life (RUL) Estimation from multi-sensor time series data is useful to enable condition-based maintenance and ensure high operational availability of equipment. We propose a novel deep lear…

regressionTime Series AnalysisUncertainty Quantification

Disentangling Aleatoric and Epistemic Uncertainty in Physics-Informed Neural Networks. Application to Insulation Material Degradation Prognostics

2026-01-07 · Ibai Ramirez, Jokin Alcibar, Joel Pino, Mikel Sanz 외 arxiv

Physics-Informed Neural Networks (PINNs) provide a framework for integrating physical laws with data. However, their application to Prognostics and Health Management (PHM) remains constrained by the limited uncertainty q…

Benchmarking Machine Learning Uncertainty Quantification Methodologies for Predicting Turbine Gas Temperature Degradation

2026-05-28 · Jostein Barry-Straume, Changmin Son, Adrian Sandu, Gavan Burke 외 arxiv

Effective prognostics and health management of modern engines relies on accurate turbine gas temperature predictions and robust uncertainty quantification to ensure reliability and safety. This paper investigates five ma…

Bayesian Physics Informed Neural Networks for Reliable Transformer Prognostics

2025-09-19 · Ibai Ramirez, Jokin Alcibar, Joel Pino, Mikel Sanz 외 arxiv

Scientific Machine Learning (SciML) integrates physics and data into the learning process, offering improved generalization compared with purely data-driven models. Despite its potential, applications of SciML in prognos…

Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial

2023-05-07 · Venkat Nemani, Luca Biggio, Xun Huan, Zhen Hu 외

On top of machine learning models, uncertainty quantification (UQ) functions as an essential layer of safety assurance that could lead to more principled decision making by enabling sound risk assessment and management. …

Decision MakingManagementregressionUncertainty Quantification