paper-with-me

Papers

Uncertainty Propagation through Trained Deep Neural Networks Using Factor Graphs

2023-12-10 · Angel Daruna, Yunye Gong, Abhinav Rajvanshi, Han-Pang Chiu, Yi Yao

Predictive uncertainty estimation remains a challenging problem precluding the use of deep neural networks as subsystems within safety-critical applications. Aleatoric uncertainty is a component of predictive uncertainty that cannot be reduced through model improvements. Uncertainty propagation seeks to estimate aleatoric uncertainty by propagating input uncertainties to network predictions. Existing uncertainty propagation techniques use one-way information flows, propagating uncertainties layer-by-layer or across the entire neural network while relying either on sampling or analytical techniques for propagation. Motivated by the complex information flows within deep neural networks (e.g. skip connections), we developed and evaluated a novel approach by posing uncertainty propagation as a non-linear optimization problem using factor graphs. We observed statistically significant improvements in performance over prior work when using factor graphs across most of our experiments that included three datasets and two neural network architectures. Our implementation balances the benefits of sampling and analytical propagation techniques, which we believe, is a key factor in achieving performance improvements.

📄 PDF Abstract BibTeX arXiv:2312.05946

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Belief Propagation, Bethe Approximation and Polynomials

2017-08-08 · Damian Straszak, Nisheeth K. Vishnoi

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partit…

Accounting for Physics Uncertainty in Ultrasonic Wave Propagation using Deep Learning

2019-11-07 · Ishan D. Khurjekar, Joel B. Harley

Ultrasonic guided waves are commonly used to localize structural damage in infrastructures such as buildings, airplanes, bridges. Damage localization can be viewed as an inverse problem. Physical model based techniques a…

Deep Learning

Neural Enhanced Belief Propagation on Factor Graphs

2020-03-04 · Victor Garcia Satorras, Max Welling

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the …

Improving Signed Propagation for Graph Neural Networks in Multi-Class Environments

2023-01-21 · Yoonhyuk Choi, Jiho Choi, Taewook Ko, Chong-Kwon Kim

Message-passing Graph Neural Networks (GNNs), which collect information from adjacent nodes achieve dismal performance on heterophilic graphs. Various schemes have been proposed to solve this problem, and propagating sig…

Graph Neural Network

Uncertainty propagation through trained multi-layer perceptrons: Exact analytical results

2026-01-23 · Andrew Thompson, Miles McCrory arxiv

We give analytical results for propagation of uncertainty through trained multi-layer perceptrons (MLPs) with a single hidden layer and ReLU activation functions. More precisely, we give expressions for the mean and vari…