On Active Learning for Gaussian Process-based Global Sensitivity Analysis
This paper explores the application of active learning strategies to adaptively learn Sobol indices for global sensitivity analysis. We demonstrate that active learning for Sobol indices poses unique challenges due to the definition of the Sobol index as a ratio of variances estimated from Gaussian process surrogates. Consequently, learning strategies must either focus on convergence in the numerator or the denominator of this ratio. However, rapid convergence in either one does not guarantee convergence in the Sobol index. We propose a novel strategy for active learning that focuses on resolving the main effects of the Gaussian process (associated with the numerator of the Sobol index) and compare this with existing strategies based on convergence in the total variance (the denominator of the Sobol index). The new strategy, implemented through a new learning function termed the MUSIC (minimize uncertainty in Sobol index convergence), generally converges in Sobol index error more rapidly than the existing strategies based on the Expected Improvement for Global Fit (EIGF) and the Variance Improvement for Global Fit (VIGF). Both strategies are compared with simple sequential random sampling and the MUSIC learning function generally converges most rapidly for low-dimensional problems. However, for high-dimensional problems, the performance is comparable to random sampling. The new learning strategy is demonstrated for a practical case of adaptive experimental design for large-scale Boundary Layer Wind Tunnel experiments.
Code (0)
등록된 구현이 없습니다.
Tasks
Active LearningExperimental DesignSensitivityMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Active Learning for Derivative-Based Global Sensitivity Analysis with Gaussian Processes
We consider the problem of active learning for global sensitivity analysis of expensive black-box functions. Our aim is to efficiently learn the importance of different input variables, e.g., in vehicle safety experiment…
Active LearningGaussian ProcessesSensitivityGradient-based Active Learning with Gaussian Processes for Global Sensitivity Analysis
Global sensitivity analysis of complex numerical simulators is often limited by the small number of model evaluations that can be afforded. In such settings, surrogate models built from a limited set of simulations can s…
Gaussian ProcessesActive LearningSequential Learning of Active Subspaces
In recent years, active subspace methods (ASMs) have become a popular means of performing subspace sensitivity analysis on black-box functions. Naively applied, however, ASMs require gradient evaluations of the target fu…
Gaussian ProcessesSensitivitysubspace methodsVariance based sensitivity analysis for Monte Carlo and importance sampling reliability assessment with Gaussian processes
Running a reliability analysis on engineering problems involving complex numerical models can be computationally very expensive, requiring advanced simulation methods to reduce the overall numerical cost. Gaussian proces…
Active LearningGaussian ProcessesSensitivityDynamic Global Sensitivity for Differentially Private Contextual Bandits
Bandit algorithms have become a reference solution for interactive recommendation. However, as such algorithms directly interact with users for improved recommendations, serious privacy concerns have been raised regardin…
Interactive RecommendationMulti-Armed BanditsSensitivity