Green Machine Learning via Augmented Gaussian Processes and Multi-Information Source Optimization
Searching for accurate Machine and Deep Learning models is a computationally expensive and awfully energivorous process. A strategy which has been gaining recently importance to drastically reduce computational time and energy consumed is to exploit the availability of different information sources, with different computational costs and different "fidelity", typically smaller portions of a large dataset. The multi-source optimization strategy fits into the scheme of Gaussian Process based Bayesian Optimization. An Augmented Gaussian Process method exploiting multiple information sources (namely, AGP-MISO) is proposed. The Augmented Gaussian Process is trained using only "reliable" information among available sources. A novel acquisition function is defined according to the Augmented Gaussian Process. Computational results are reported related to the optimization of the hyperparameters of a Support Vector Machine (SVM) classifier using two sources: a large dataset - the most expensive one - and a smaller portion of it. A comparison with a traditional Bayesian Optimization approach to optimize the hyperparameters of the SVM classifier on the large dataset only is reported.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian OptimizationBIG-bench Machine LearningGaussian ProcessesMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fast Kernel Approximations for Latent Force Models and Convolved Multiple-Output Gaussian processes
A latent force model is a Gaussian process with a covariance function inspired by a differential operator. Such covariance function is obtained by performing convolution integrals between Green's functions associated to …
Gaussian ProcessesHigh-dimensional mixed-categorical Gaussian processes with application to multidisciplinary design optimization for a green aircraft
Recently, there has been a growing interest in mixed-categorical metamodels based on Gaussian Process (GP) for Bayesian optimization. In this context, different approaches can be used to build the mixed-categorical GP. M…
Bayesian OptimizationCantilever BeamDimensionality ReductionGaussian ProcessesThe Green Management Towards a Green Industrial Revolution
Green Management (GM) is now one of many methods proposed to achieve new, more ecological, and sustainable economic models. The paper is focused on the impact of the developing human population on the environment measure…
ManagementThe Fast Kernel Transform
Kernel methods are a highly effective and widely used collection of modern machine learning algorithms. A fundamental limitation of virtually all such methods are computations involving the kernel matrix that naively sca…
Gaussian ProcessesUnderstanding Climate Impacts on Vegetation with Gaussian Processes in Granger Causality
Global warming is leading to unprecedented changes in our planet, with great societal, economical and environmental implications, especially with the growing demand of biofuels and food. Assessing the impact of climate o…
Gaussian Processes