Generative models uncertainty estimation
In recent years fully-parametric fast simulation methods based on generative models have been proposed for a variety of high-energy physics detectors. By their nature, the quality of data-driven models degrades in the regions of the phase space where the data are sparse. Since machine-learning models are hard to analyse from the physical principles, the commonly used testing procedures are performed in a data-driven way and can't be reliably used in such regions. In our work we propose three methods to estimate the uncertainty of generative models inside and outside of the training phase space region, along with data-driven calibration techniques. A test of the proposed methods on the LHCb RICH fast simulation is also presented.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generative Posterior Networks for Approximately Bayesian Epistemic Uncertainty Estimation
In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic unce…
Dense Uncertainty Estimation
Deep neural networks can be roughly divided into deterministic neural networks and stochastic neural networks.The former is usually trained to achieve a mapping from input space to output space via maximum likelihood est…
Decision MakingEvaluating Aleatoric Uncertainty via Conditional Generative Models
Aleatoric uncertainty quantification seeks for distributional knowledge of random responses, which is important for reliability analysis and robustness improvement in machine learning applications. Previous research on a…
Uncertainty QuantificationA Bias-Variance-Covariance Decomposition of Kernel Scores for Generative Models
Generative models, like large language models, are becoming increasingly relevant in our daily lives, yet a theoretical framework to assess their generalization behavior and uncertainty does not exist. Particularly, the …
Image GenerationQuestion AnsweringText GenerationTriviaQAQuantifying Uncertainty In Traffic State Estimation Using Generative Adversarial Networks
This paper aims to quantify uncertainty in traffic state estimation (TSE) using the generative adversarial network based physics-informed deep learning (PIDL). The uncertainty of the focus arises from fundamental diagram…
Generative Adversarial NetworkState EstimationUncertainty Quantification