paper-with-me

Papers

Multi-view Bayesian optimisation in reduced dimension for engineering design

2025-01-02 · Thomas A. Archbold, Ieva Kazlauskaite, Fehmi Cirak

Bayesian optimisation is an adaptive sampling strategy for constructing a Gaussian process surrogate to emulate a black-box computational model with the aim of efficiently searching for the global minimum. However, Gaussian processes have limited applicability for engineering problems with many design variables. Their scalability can be significantly improved by identifying a low-dimensional vector of latent variables that serve as inputs to the Gaussian process. In this paper, we introduce a multi-view learning strategy that considers both the input design variables and output data representing the objective or constraint functions, to identify a low-dimensional space of latent variables. Adopting a fully probabilistic viewpoint, we use probabilistic partial least squares (PPLS) to learn an orthogonal mapping from the design variables to the latent variables using training data consisting of inputs and outputs of the black-box computational model. The latent variables and posterior probability densities of the probabilistic partial least squares and Gaussian process models are determined sequentially and iteratively, with retraining occurring at each adaptive sampling iteration. We compare the proposed probabilistic partial least squares Bayesian optimisation (PPLS-BO) strategy to its deterministic counterpart, partial least squares Bayesian optimisation (PLS-BO), and classical Bayesian optimisation, demonstrating significant improvements in convergence to the global minimum.

📄 PDF Abstract BibTeX arXiv:2501.01552

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimisationGaussian ProcessesMULTI-VIEW LEARNING

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Dimensionality Reduction Techniques for Global Bayesian Optimisation

2024-12-12 · Luo Long, Coralia Cartis, Paz Fink Shustin

Bayesian Optimisation (BO) is a state-of-the-art global optimisation technique for black-box problems where derivative information is unavailable, and sample efficiency is crucial. However, improving the general scalabil…

Bayesian OptimisationDimensionality ReductionGaussian Processesglobal-optimization+1

Deep Learning: A Bayesian Perspective

2017-06-01 · Nicholas Polson, Vadim Sokolov

Deep learning is a form of machine learning for nonlinear high dimensional pattern matching and prediction. By taking a Bayesian probabilistic perspective, we provide a number of insights into more efficient algorithms f…

Deep LearningregressionVariable Selection

Multi-fidelity Bayesian Optimisation with Continuous Approximations

2017-03-18 · ICML 2017 8 · Kirthevasan Kandasamy, Gautam Dasarathy, Jeff Schneider, Barnabas Poczos

Bandit methods for black-box optimisation, such as Bayesian optimisation, are used in a variety of applications including hyper-parameter tuning and experiment design. Recently, \emph{multi-fidelity} methods have garnere…

Bayesian Optimisation

Variational Bayesian surrogate modelling with application to robust design optimisation

2024-04-23 · Thomas A. Archbold, Ieva Kazlauskaite, Fehmi Cirak

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are…

Bayesian InferenceDimensionality ReductionRobust Design

Choice functions based multi-objective Bayesian optimisation

2021-10-15 · Alessio Benavoli, Dario Azzimonti, Dario Piga

In this work we introduce a new framework for multi-objective Bayesian optimisation where the multi-objective functions can only be accessed via choice judgements, such as ``I pick options A,B,C among this set of five op…

Bayesian Optimisation