paper-with-me

홈 › Papers

Deep active subspaces - a scalable method for high-dimensional uncertainty propagation

2019-02-27 · Rohit Tripathy, Ilias Bilionis

A problem of considerable importance within the field of uncertainty quantification (UQ) is the development of efficient methods for the construction of accurate surrogate models. Such efforts are particularly important to applications constrained by high-dimensional uncertain parameter spaces. The difficulty of accurate surrogate modeling in such systems, is further compounded by data scarcity brought about by the large cost of forward model evaluations. Traditional response surface techniques, such as Gaussian process regression (or Kriging) and polynomial chaos are difficult to scale to high dimensions. To make surrogate modeling tractable in expensive high-dimensional systems, one must resort to dimensionality reduction of the stochastic parameter space. A recent dimensionality reduction technique that has shown great promise is the method of `active subspaces'. The classical formulation of active subspaces, unfortunately, requires gradient information from the forward model - often impossible to obtain. In this work, we present a simple, scalable method for recovering active subspaces in high-dimensional stochastic systems, without gradient-information that relies on a reparameterization of the orthogonal active subspace projection matrix, and couple this formulation with deep neural networks. We demonstrate our approach on synthetic and real world datasets and show favorable predictive comparison to classical active subspaces.

📄 PDF Abstract BibTeX arXiv:1902.10527

Code (1)

wedeling/EasySurrogate

Tasks

Dimensionality ReductionUncertainty QuantificationVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Learning Active Subspaces for Effective and Scalable Uncertainty Quantification in Deep Neural Networks

2023-09-06 · Sanket Jantre, Nathan M. Urban, Xiaoning Qian, Byung-Jun Yoon

Bayesian inference for neural networks, or Bayesian deep learning, has the potential to provide well-calibrated predictions with quantified uncertainty and robustness. However, the main hurdle for Bayesian deep learning …

Bayesian InferenceDeep LearningUncertainty QuantificationVariational Inference

Leveraging Active Subspaces to Capture Epistemic Model Uncertainty in Deep Generative Models for Molecular Design

2024-04-30 · A N M Nafiz Abeer, Sanket Jantre, Nathan M Urban, Byung-Jun Yoon

Deep generative models have been accelerating the inverse design process in material and drug design. Unlike their counterpart property predictors in typical molecular design frameworks, generative molecular design model…

Bayesian InferenceDiversityDrug DesignUncertainty Quantification

Combining additivity and active subspaces for high-dimensional Gaussian process modeling

2024-02-06 · Mickael Binois, Victor Picheny

Gaussian processes are a widely embraced technique for regression and classification due to their good prediction accuracy, analytical tractability and built-in capabilities for uncertainty quantification. However, they …

Gaussian ProcessesUncertainty Quantification

Subspace Inference for Bayesian Deep Learning

2019-07-17 · Pavel Izmailov, Wesley J. Maddox, Polina Kirichenko, Timur Garipov 외

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neur…

Bayesian InferenceDeep Learningimage-classificationImage Classification+2

Scalable Bottom-up Subspace Clustering using FP-Trees for High Dimensional Data

2018-11-07 · Minh Tuan Doan, Jianzhong Qi, Sutharshan Rajasegarar, Christopher Leckie

Subspace clustering aims to find groups of similar objects (clusters) that exist in lower dimensional subspaces from a high dimensional dataset. It has a wide range of applications, such as analysing high dimensional sen…

Clustering