Adaptive Basis Function Selection for Computationally Efficient Predictions
Basis Function (BF) expansions are a cornerstone of any engineer's toolbox for computational function approximation which shares connections with both neural networks and Gaussian processes. Even though BF expansions are an intuitive and straightforward model to use, they suffer from quadratic computational complexity in the number of BFs if the predictive variance is to be computed. We develop a method to automatically select the most important BFs for prediction in a sub-domain of the model domain. This significantly reduces the computational complexity of computing predictions while maintaining predictive accuracy. The proposed method is demonstrated using two numerical examples, where reductions up to 50-75% are possible without significantly reducing the predictive accuracy.
Code (1)
Tasks
Gaussian ProcessesSimilar Papers 제목 키워드 기반
Adaptive RBF-KAN: A Comparative Evaluation of Dynamic Shape Parameters in Kolmogorov-Arnold Networks
Kolmogorov-Arnold Networks (KANs) approximate multivariate functions using learnable univariate edge functions, typically parameterized by B-spline bases. Although effective, spline-based implementations can be computati…
Automatic selection of basis-adaptive sparse polynomial chaos expansions for engineering applications
Sparse polynomial chaos expansions (PCE) are an efficient and widely used surrogate modeling method in uncertainty quantification for engineering problems with computationally expensive models. To make use of the availab…
Compressive SensingExperimental DesignUncertainty QuantificationAdaptive Bayesian Linear Regression for Automated Machine Learning
To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine…
AutoMLBayesian OptimizationBIG-bench Machine LearningHyperparameter Optimization+3HCMS: Hierarchical and Conditional Modality Selection for Efficient Video Recognition
Videos are multimodal in nature. Conventional video recognition pipelines typically fuse multimodal features for improved performance. However, this is not only computationally expensive but also neglects the fact that d…
Video RecognitionDynamic Basis Function Interpolation for Adaptive In Situ Data Integration in Ocean Modeling
We propose a new method for combining in situ buoy measurements with Earth system models (ESMs) to improve the accuracy of temperature predictions in the ocean. The technique utilizes the dynamics \textit{and} modes iden…
Data Integration