paper-with-me

Papers

Multi-fidelity classification using Gaussian processes: accelerating the prediction of large-scale computational models

2019-05-09 · Francisco Sahli Costabal, Paris Perdikaris, Ellen Kuhl, Daniel E. Hurtado

Machine learning techniques typically rely on large datasets to create accurate classifiers. However, there are situations when data is scarce and expensive to acquire. This is the case of studies that rely on state-of-the-art computational models which typically take days to run, thus hindering the potential of machine learning tools. In this work, we present a novel classifier that takes advantage of lower fidelity models and inexpensive approximations to predict the binary output of expensive computer simulations. We postulate an autoregressive model between the different levels of fidelity with Gaussian process priors. We adopt a fully Bayesian treatment for the hyper-parameters and use Markov Chain Mont Carlo samplers. We take advantage of the probabilistic nature of the classifier to implement active learning strategies. We also introduce a sparse approximation to enhance the ability of themulti-fidelity classifier to handle large datasets. We test these multi-fidelity classifiers against their single-fidelity counterpart with synthetic data, showing a median computational cost reduction of 23% for a target accuracy of 90%. In an application to cardiac electrophysiology, the multi-fidelity classifier achieves an F1 score, the harmonic mean of precision and recall, of 99.6% compared to 74.1% of a single-fidelity classifier when both are trained with 50 samples. In general, our results show that the multi-fidelity classifiers outperform their single-fidelity counterpart in terms of accuracy in all cases. We envision that this new tool will enable researchers to study classification problems that would otherwise be prohibitively expensive. Source code is available at https://github.com/fsahli/MFclass.

📄 PDF Abstract BibTeX arXiv:1905.03406

Code (1)

fsahli/MFclass 공식 구현

Tasks

Active LearningBIG-bench Machine LearningGaussian ProcessesGeneral Classification

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Multi-fidelity modeling with different input domain definitions using Deep Gaussian Processes

2020-06-29 · Ali Hebbal, Loic Brevault, Mathieu Balesdent, El-Ghazali Talbi 외

Multi-fidelity approaches combine different models built on a scarce but accurate data-set (high-fidelity data-set), and a large but approximate one (low-fidelity data-set) in order to improve the prediction accuracy. Ga…

Gaussian Processes

Multi-fidelity Gaussian Process for Biomanufacturing Process Modeling with Small Data

2022-11-26 · Yuan Sun, Winton Nathan-Roberts, Tien Dung Pham, Ellen Otte 외

In biomanufacturing, developing an accurate model to simulate the complex dynamics of bioprocesses is an important yet challenging task. This is partially due to the uncertainty associated with bioprocesses, high data ac…

Transfer Learning

Deep Multi-fidelity Gaussian Processes

2016-04-26 · Maziar Raissi, George Karniadakis

We develop a novel multi-fidelity framework that goes far beyond the classical AR(1) Co-kriging scheme of Kennedy and O'Hagan (2000). Our method can handle general discontinuous cross-correlations among systems with diff…

Gaussian Processes

Safe Real-Time Optimization using Multi-Fidelity Gaussian Processes

2021-11-10 · Panagiotis Petsagkourakis, Benoit Chachuat, Ehecatl Antonio del Rio-Chanona

This paper proposes a new class of real-time optimization schemes to overcome system-model mismatch of uncertain processes. This work's novelty lies in integrating derivative-free optimization schemes and multi-fidelity …

Bayesian OptimizationGaussian ProcessesUncertainty Quantification

Optimizing Photonic Nanostructures via Multi-fidelity Gaussian Processes

2018-11-15 · Jialin Song, Yury S. Tokpanov, Yuxin Chen, Dagny Fleischman 외

We apply numerical methods in combination with finite-difference-time-domain (FDTD) simulations to optimize transmission properties of plasmonic mirror color filters using a multi-objective figure of merit over a five-di…

Gaussian Processes