PCENet: High Dimensional Surrogate Modeling for Learning Uncertainty
Learning data representations under uncertainty is an important task that emerges in numerous machine learning applications. However, uncertainty quantification (UQ) techniques are computationally intensive and become prohibitively expensive for high-dimensional data. In this paper, we present a novel surrogate model for representation learning and uncertainty quantification, which aims to deal with data of moderate to high dimensions. The proposed model combines a neural network approach for dimensionality reduction of the (potentially high-dimensional) data, with a surrogate model method for learning the data distribution. We first employ a variational autoencoder (VAE) to learn a low-dimensional representation of the data distribution. We then propose to harness polynomial chaos expansion (PCE) formulation to map this distribution to the output target. The coefficients of PCE are learned from the distribution representation of the training data using a maximum mean discrepancy (MMD) approach. Our model enables us to (a) learn a representation of the data, (b) estimate uncertainty in the high-dimensional data system, and (c) match high order moments of the output distribution; without any prior statistical assumptions on the data. Numerical experimental results are presented to illustrate the performance of the proposed method.
Code (0)
등록된 구현이 없습니다.
Tasks
Dimensionality ReductionRepresentation LearningUncertainty QuantificationVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Dimensionality reduction can be used as a surrogate model for high-dimensional forward uncertainty quantification
We introduce a method to construct a stochastic surrogate model from the results of dimensionality reduction in forward uncertainty quantification. The hypothesis is that the high-dimensional input augmented by the outpu…
Dimensionality ReductionUncertainty QuantificationConditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems
We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributi…
Probabilistic Deep LearningVariational InferenceDeep convolutional neural networks for uncertainty propagation in random fields
The development of a reliable and robust surrogate model is often constrained by the dimensionality of the problem. For a system with high-dimensional inputs/outputs (I/O), conventional approaches usually use a low-dimen…
Uncertainty QuantificationAdaptive surrogate modeling for high-dimensional spatio-temporal output
This paper develops an adaptive surrogate modeling method for problems with very high-dimensional spatio-temporal outputs. The analysis of spatio-temporal multi-physics systems is computationally expensive and consists o…
Computational EfficiencyDeep active subspaces - a scalable method for high-dimensional uncertainty propagation
A problem of considerable importance within the field of uncertainty quantification (UQ) is the development of efficient methods for the construction of accurate surrogate models. Such efforts are particularly important …
Dimensionality ReductionUncertainty QuantificationVocal Bursts Intensity Prediction