paper-with-me

홈 › Papers

Probabilistic Neural Networks (PNNs) with t-Distributed Outputs: Adaptive Prediction Intervals Beyond Gaussian Assumptions

2025-03-16 · Farhad Pourkamali-Anaraki

Traditional neural network regression models provide only point estimates, failing to capture predictive uncertainty. Probabilistic neural networks (PNNs) address this limitation by producing output distributions, enabling the construction of prediction intervals. However, the common assumption of Gaussian output distributions often results in overly wide intervals, particularly in the presence of outliers or deviations from normality. To enhance the adaptability of PNNs, we propose t-Distributed Neural Networks (TDistNNs), which generate t-distributed outputs, parameterized by location, scale, and degrees of freedom. The degrees of freedom parameter allows TDistNNs to model heavy-tailed predictive distributions, improving robustness to non-Gaussian data and enabling more adaptive uncertainty quantification. We develop a novel loss function tailored for the t-distribution and derive efficient gradient computations for seamless integration into deep learning frameworks. Empirical evaluations on synthetic and real-world data demonstrate that TDistNNs improve the balance between coverage and interval width. Notably, for identical architectures, TDistNNs consistently produce narrower prediction intervals than Gaussian-based PNNs while maintaining proper coverage. This work contributes a flexible framework for uncertainty estimation in neural networks tasked with regression, particularly suited to settings involving complex output distributions.

📄 PDF Abstract BibTeX arXiv:2503.12354

Code (0)

등록된 구현이 없습니다.

Tasks

Prediction IntervalsregressionUncertainty Quantification

Similar Papers 제목 키워드 기반

Probabilistic Neural Networks (PNNs) for Modeling Aleatoric Uncertainty in Scientific Machine Learning

2024-02-21 · Farhad Pourkamali-Anaraki, Jamal F. Husseini, Scott E. Stapleton

This paper investigates the use of probabilistic neural networks (PNNs) to model aleatoric uncertainty, which refers to the inherent variability in the input-output relationships of a system, often characterized by unequ…

regression

Probabilistic Graph Rewiring via Virtual Nodes

2024-05-27 · Chendi Qian, Andrei Manolache, Christopher Morris, Mathias Niepert

Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limi…

Computational Efficiency

Probabilistically Rewired Message-Passing Neural Networks

2023-10-03 · Chendi Qian, Andrei Manolache, Kareem Ahmed, Zhe Zeng 외

Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Fur…

Context-adaptive neural network based prediction for image compression

2018-07-17 · Thierry Dumas, Aline Roumy, Christine Guillemot

This paper describes a set of neural network architectures, called Prediction Neural Networks Set (PNNS), based on both fully-connected and convolutional neural networks, for intra image prediction. The choice of neural …

DecoderImage CompressionPrediction

Dual adaptive training of photonic neural networks

2022-12-09 · Ziyang Zheng, Zhengyang Duan, Hang Chen, Rui Yang 외

Photonic neural network (PNN) is a remarkable analog artificial intelligence (AI) accelerator that computes with photons instead of electrons to feature low latency, high energy efficiency, and high parallelism. However,…

image-classificationImage Classification