paper-with-me

홈 › Papers

A Robust Asymmetric Kernel Function for Bayesian Optimization, with Application to Image Defect Detection in Manufacturing Systems

2021-09-22 · Areej AlBahar, Inyoung Kim, Xiaowei Yue

Some response surface functions in complex engineering systems are usually highly nonlinear, unformed, and expensive-to-evaluate. To tackle this challenge, Bayesian optimization, which conducts sequential design via a posterior distribution over the objective function, is a critical method used to find the global optimum of black-box functions. Kernel functions play an important role in shaping the posterior distribution of the estimated function. The widely used kernel function, e.g., radial basis function (RBF), is very vulnerable and susceptible to outliers; the existence of outliers is causing its Gaussian process surrogate model to be sporadic. In this paper, we propose a robust kernel function, Asymmetric Elastic Net Radial Basis Function (AEN-RBF). Its validity as a kernel function and computational complexity are evaluated. When compared to the baseline RBF kernel, we prove theoretically that AEN-RBF can realize smaller mean squared prediction error under mild conditions. The proposed AEN-RBF kernel function can also realize faster convergence to the global optimum. We also show that the AEN-RBF kernel function is less sensitive to outliers, and hence improves the robustness of the corresponding Bayesian optimization with Gaussian processes. Through extensive evaluations carried out on synthetic and real-world optimization problems, we show that AEN-RBF outperforms existing benchmark kernel functions.

📄 PDF Abstract BibTeX arXiv:2109.10898

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian OptimizationDefect DetectionGaussian Processes

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Nonlinear SVD with Asymmetric Kernels: feature learning and asymmetric Nyström method

2023-06-12 · Qinghua Tao, Francesco Tonin, Panagiotis Patrinos, Johan A. K. Suykens

Asymmetric data naturally exist in real life, such as directed graphs. Different from the common kernel methods requiring Mercer kernels, this paper tackles the asymmetric kernel-based learning problem. We describe a non…

Bayesian Optimization for auto-tuning GPU kernels

2021-11-26 · Floris-Jan Willemsen, Rob van Nieuwpoort, Ben van Werkhoven

Finding optimal parameter configurations for tunable GPU kernels is a non-trivial exercise for large search spaces, even when automated. This poses an optimization task on a non-convex search space, using an expensive to…

Bayesian OptimizationGPU

Random Fourier Features for Asymmetric Kernels

2022-09-18 · Mingzhen He, Fan He, Fanghui Liu, Xiaolin Huang

The random Fourier features (RFFs) method is a powerful and popular technique in kernel approximation for scalability of kernel methods. The theoretical foundation of RFFs is based on the Bochner theorem that relates sym…

Computational Efficiency

Geometry-aware Bayesian Optimization in Robotics using Riemannian Matérn Kernels

2021-11-02 · Noémie Jaquier, Viacheslav Borovitskiy, Andrei Smolensky, Alexander Terenin 외

Bayesian optimization is a data-efficient technique which can be used for control parameter tuning, parametric policy adaptation, and structure design in robotics. Many of these problems require optimization of functions…

Bayesian OptimizationMotion Planning

BARK: A Fully Bayesian Tree Kernel for Black-box Optimization

2025-03-07 · Toby Boyne, Jose Pablo Folch, Robert M Lee, Behrang Shafei 외

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and …

Bayesian OptimizationGaussian Processesglobal-optimizationUncertainty Quantification